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ABSTRACT 

The second volume of the study contains the sections 
on management feasibility and economic feasibility, which comprise 
more than two-thirds of the document, arid sections on simulation 
modelinq, client acceptability, inservice desiqn, evaluation, and 
maintaining relevance of the model for teacher education in the 
1970‘s. The section on management feasibility describes the 
administration arrangements that have been conceived to accomodate 
the program and the steps that will be taken to implement these 
arrangements, "’'he section on economic feasibility presents a c -vear 
budget, outline, with breakdowns for each program subsystem. It 
identifies an optimally feasible number of students, proficiency 
modules, and instructional alternatives. The section on simulation 
gives a brief description of the simulation models used and their 
respective functions, and the section on client acceptability relates 
the use of several methods to oath^r opinions on the 
model--quest ionnaires, conferences, and the Delphi ^echnioue. The 
section on inservice design contains the results of a survey made pv 
the Massachusetts Center for the Study of Educational Innovations to 
a ssess ♦ he inservice needs of Massachusetts teachers. Subsequent 
sections briefly describe plans for evaluating and continuously 
updating the model. (Volume I of the study is SP 094 2*9 and a 
separate summary is SP 004 261.) (RT) 
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Educational Programming Systems - An Overview 



The Mode*! Elementary Teacher Education Program is concerned in part 
v?j.th dfvc]oi>h\ f f ' y an organisational process that v/i.ll ho. responsive and 
adaptive, As noted in previous file report number 8-9023, p.7, 

"There can no longer be any doubt that education as a 
proCessional endeavor muni undergo radical changes in 
the decades ahead. The present attempts to append 
minor improvements to the m axe oC existing practices are 
simply not sufficiently bold and imaginative enough to 
meet with the*. rapidly changing needs that face American 
education, if meaningful changes arc to bn made in the 
profession, we most go beyond the more development of new 
variations on old themes. In fact, professionalism in 
education is likeJv to din out unless we capitalize on 
the process of change. VJe must institutionalize change 
so that it becomes an integral part of the educational 
structure i therbv meeting the functional needs of society 
and the individual students as they arise." 

What is required is a row and improved educational programming 
system. An educational programming .system can be defined ns Chat 
institutional proe ess whereby educations 1 programs are clove loped , 
instituted, operated, and reviewed. A school oi education >.n ih,.t 
segment that is concerned with elementary education can be vievrou as 
such a system. 

KETF.P represents a suggested innovation in educational programming 
m an imp rove wen I in the state of ».lu> art, or the creation of new 
knowledge. To determine whether IIETEP represents such an increment in 
the state of the art one has to compare it to the present state, of the 
art, or hov; educational programs arc currently typically developed and 
delivered. 

Method of Analysis. In order to illustrate the improvement in education 
a) programming that METEP represents, first a model of the current state 
oi the art will be presented and analyzed and then u nodal of l SETUP will 
be presented, and, finally, the two models will bo compared. As tiic 
established or traditional educational programing processes or*: veil 
knovn they need cnly bo briefly reviewed, so as to recall for the 
purposes of analysis their essential characteristics. Tigurc 1 
represents n hypothetical organization stricture of a typical school of 
education. This might he a state college or university. Such n School 
is organized along academic disciplines and it may have areas or 
departments of oJomcuUaiy education, secondary education, vocational 
education, graduate education, etc. The adninist rat ive structure may 
consist of n dean and an assistant dean. If one takes one segment, 

*urh as elementary education, typically one finds a faculty advisor for 
students who are majoring in clcmoulaiy education. Advising ray 
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Elementary arcondary Education Vo. Ed. Graduate Ed* 

Education (Advisor - Students) (Advisor - Students) (Advisor) 

(Advisor - Students) Facutly Faculty Faculty 

Faculty (Committee Program) (Committee Program) (Committee Program) 

(Committee Program) 



constitute, part of: his faculty duties. In addition, there would bo. a 
facility cojni'il t tcic roup msiblo for developing educational programs or 
courses in elementary education, If the school i s organized alone, 
departmental lines, there may he n chairman or department head in 
charge of elementary education, The assistant dean ray he responsible 
for preparing yearly budgets, scheduling rooms, faculty courses, and 
providing services, such as providing secretaries for the faculty. 

Figure 2 represents a very rough organisational programming process 
as it is presently executed, It should be noted Lliat the expected 
output of this programing process is an increase in the academic, 
reputation of the faculty, department, and/or school. An academic 
status hierarchy exists in which, through peer evaluation, schools cf 
education, or the elementary education segr.cn t of such schools or 
individual, faculty are evaluated by each other. If a department or a 
school wants to maintain or increase its academic reputation, its effort, 
then, is directed toward oilier faculty in their respective discipline. 
Thus, one lias essentially one client group toward which that organization- 
al programming is directed - the academic community. Stalling at Lho 
beginning of the figure, faculty and/or donna at teir.pt to remain current 
as to what other schools of education or faculty are doing. This u:n 
bo done by attending meetings or reading the literature in the field. 

If certain changes Aia occurring, particularly on the port of high 
prestige schools, there is a tendency to emulate such changes. As a 
consequence, new programs in the form of new courses r.ny be prepared by 
either the individual faculty ran. or jii consultation with his peers in 
the area or department within a school , Such proposals are then 
submitted to the school faculty senate and, perhaps, the Lctal 
university senate for approval. Once such approval is achieved these 
new courses have to be authorized by the dean and, perhaps, the provost, 
and a budget necessary to support such programs acquired. The argument 
for budgetary approval is usually that such new programs will increase 
the academic prestige of the department and/or school, and require an 
addition in space , personnel and equipment. Once such approval is 
achieved, the faculty who proposed the courses then torch the courses. 
Essentially the same, process occurs insofar as faculty research is 
concerned, except this is entirely an individual undertaking, where 
the individual faculty select problems of interest to then, conduct 
their research, and publish such research, again to their peers. Given 
the faculty's publications outputs to other faculty and the academic 
programs which they are currently conducting, both of which ore directed 
toward the faculty of other schools of education, tiie faculty hope that 
such an output will be viewed favorably and the academic reputation of 
the school, in terms of its relative ranking or status, will be 
improved . 



Mint are some of the essential characteristics of the present 
educational programming system? In terms of its organizational structure 
and process, perhaps the closest analogy one could use is that it is 
essentially a guild system. In a guild system one relies basically on a 
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Faculcy of ocher schools of education 
output - directed toward academic peers 



craftsman or no nrLi.snu, which in this case js the faculty, to product* 
or make the entire product on entirely an individual basis. ]n the 
present system we have the individual faculty man perceiving what the 
programing need is, declining new educational, programs in the form of 
course content, processing In's proposals through the athiini s t rat ivo 
apparatus, teaching t lie course, once approved and in the catalogue, and 
subsequently evaluating hit; own effort. 

In terms of organisational staffing patterns there is only one 
professional vole; one does not find a differentiated ,>Lnff. The one 
role is that of ihc faculty man. And, as in any guild system, to join 
the guild one has to serve an apprenticeship in the form of graduate 
study and acquire, o Ph.D. degree before one can become a member of the 
guild. In terms of a total programming effort, what one has clearly is 
what might be considered a nun- integrated system random process, whereby 
each craftsman is able to develop anu deliver his own unique produce. 
There need not be any relationship between one course or educational 
program and another course, in fact, if there were such a relationship 
it would be entirely accidental. Or, as noted in report M A Feasibility 
Study for Phase Two of the Elemental y Teacher Education Project 11 , p. 15, 
what occurs is the "Prevailing process of independently introducing a 
variety of often unrelated changes, such as calendar innovations, 
curricular modifications, independent study programs, new facilities in 
computer-assisted instruction . " The educational process, in a sense, is 
similar to a Medieval fair, in which individual craftsmen - the faculty - 
offer their wares, which they have lovingly developed and which ,ne 
uniquely their own, to the student, who can pick and choose to satisfy 
relatively loose requi» ements . As there is great variability between 
artisans and great individual autonomy, one gets a very random, non- 
integrated result. 

The educational process is frequently thought of as a sequential, 
educational productive process, in which the student moves logically 
from one course progressively to another course, all of which arc 
necessary and logically provided to achieve a given end product. This 
analysis suggests as presently conducted, the educational process in 
not a process at all, but essentially an academic market place where, 
within the monopoly constraints in the form of required courses, artisans 
negotiate among themselves (share of market, everything going through 
the faculty senate), and the students shop around. Within ixmopolistic 
constraints noted, artisans compete with each other in the selling of 
their wares to the passing student largely in terms of academic worth. 
Their courses are rx)rc "rigorous", "significant", "productive", "worth- 
while". Tliis is the academic guild market place, and, if the artisan 
is successful, he will be promoted, receive academic recognition, more 
incotT**, more consulting, etc. There is little reason to believe what a 
student buys in one "stall" will be In any vay related to the next 
"stall". This can result in duplication, voids, and Jittlc relation to 
end product student results. 
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In to.jTn;? of the budgetary process, Jtjiuis ore allocated essentially 
along fixed ratios. Tor example, for every additional 15 students a 
school can aequi re one faculty man, and schools arc built so that one 
has classrooms hi which one can maintain a one to thirty student toucher 
rati o. 



As to a scFieolV; clients and environment; in the main, ns noted, the 
of f oi L of the school js directed toward a single client group ** other 
acadcri.cs. The clicnL group of a school of education are other seliools 
of education in the country. Other client groups, such as students, tax 
payers, public school systems, or society in general are ignored. The 
existing educational programming system is essentially a closed one or 
one that is restricted essentially to the academic community itself. 

Other constituent group?* are precluded. Such a closed system is directed 
essentially toward (he satisfaction of academic values ns distinct from 
economic or social values. The question of academic values and their 
maintenance shall he taken up at the end of this report. 

As noted in the outset of this report, inherent in the entire Ml'TEP 
effort is the concept, of a responsive and an adaptive educational 
programming, system, in the form of responding to changes in the environ*- 
went and new demands by client groups, How responsive or adaptive is the 
present or traditional educational programming system? The traditional 
system is essentially n sclf-tnergizing system. Either the individual 
faculty man or the dean or both, in terms of whatever ad ‘vantage* they 
never i vo ; have *o initiate educational programming changes. If thuy 
perceive no advantages, then no change will occur. There is a tendency 
for such a system to move to a static state. If the faculty and the 
dean are relatively satisfied and perceive no academic advantage in 
introducing new programs, then the sysLcm v: ill remain unchanged, and the 
same courses will ho taught in the same way by the same artisans i/ith 
the same requirements over what could he a very long period of tirv j Why 
can tills and why does this happen? As noted previously, this is cssen* 
tially a closed system, moaning that iL is effectively protected from 
external demands and pressures in its external environment . It does not 
have to conpeto for consumers as night bo the case with a business firm. 
Traditionally, business firms in the United Status, as one form of 
competition, have continually introduced new and improved products for 
the consumer as a device for increasing their share of the Market 
and increasing their profits. The academic community finds itself in 
a (monopoly position in which one of the clients at least - the students - 
must accept what the academic community is willing to deliver. Foil owing 
that old bromide ** there is little reason why the academic system will 
not make and deliver buggy whips indefinitely. 

There are no organizational mechanisms whereby the clients can 
effectively make demands on the educational programing system cither 
for change a or to moot client needs. There are no internal processes 
within t lie system that will automatically generate demands for a new 
program. 




332 



f 



Given such an educational programming system a natural development 
would be that the educational process would become increasingly divorced 
from tbe rest of society until it became so irrelevant that n crisis 
would be reached . Other client groups, such as students, tax payers, 
the professional business community, etc. would begin to make demands 
in any manner they could to assure that tbe academic process did not 
become a complete -waste of line and resources. This is, of course, 
what is currently happening and what has created the demand for change. 
However, one must recognize that the current situation is a unique one. 
and the typical nta-a of affairs, if one would go back ten or fifteen 
years, is one in which there exists essentially a non-adaptive, non- 
responsive system, Tbe present educational crisis has emphasized the 
inadequacy of the traditional educational programming system in terns 
of its organizational structure, processes, techniques, functions, and 
value system. The KETEP model is an attempt to rectify what are obvious 
and serious deficiencies in the present state of the art of organization 
al educational programming processes. 
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MUTEP Model 



The MfiTkP model represents an innovation in organize U. onal 
process, function, structure, and values in tonus of educational 
programming systems, Tills model is directed toward the correction of 
the deficiencies found in the traditional model which has been reviewed 
above. The NkTTP model will first be explained and its essential 
characteristics noted. A comparison will then be made with the 
traditional model and, finally , the advantages of the METHP invention 
V7±li be delineated. 

Figure 3, METfiP Organizational Programming Sequence, provides a 
rough overview of the proposed educational programming system. It should 
be noted that the model is made up of a series of sub-systems; this aspect 
of the report is concerned only with looking at the total system and the 
interrelationship between the sub-systems. The detailed operation of 
each of the sub-systems will be taken up elsewhere in the report. 

Under the rubric of clients, one should note that a series of 
groups whom the system is to nerve has been delineated - students in the 
program, public school administrators, public school teachers, state 
department of education, parents of children :iu school, children in 
public schools, academic community educational centers, etc. Data as to 
characteristics of the clients, their members > their demands, and needs, 
is picked up by a function which, on the chart, is noted as the analysis 
of client demands or sometimes referred to as determination of client 
acceptability. This function presents a central, monitoring effort on the 
part of tli e organization, or an intelligence unit to ascertain what the 
external demands are, insofar as the system is concerned. It is assumed 
that the nature of the clients will change over time, that their demands 
will change, and this unit will, through appropriate monitoring 
procedures, sensitize the system to such changes. In addition, this 
unit will be c» accrued with more general changes in the environment, 
which relate to what other educational schools' research units are doing, 
what new technology is emerging in the field, and, in general, will 
concern itself with the overall problem of changing societal demands on 
the educational system. 

Given the analysis of the intelligence unit as to changing environ- 
mental demands, such analysis will be sent to a research and development 
unit with concurrent recommendations that either new programs have to 
be invented, or existing programs have to be modified to meet changing 
environmental demands. It is expected that this research and develop- 
ment unit will develop educational programs in a fairly rigorous fashion, 
in Lhe sense that prior to their implementation, feasibility, compatibility 
with the rest of the system, and client acceptability have been demonstrat- 
ed. Within such a unit one would, of course, encourage as much creativity 
as possible, and research may be undertaken in developing, new educational 
programs for which there may not have been a prior client analysis 
performed . Given such program development, the research and development 
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unit can ask wliat the intelligence, unit ascertained as to the client 
accept :ah.U ity ot such new programs. In other words, insofar as research 
and development Js concerned, Lhr* initiative for the development of new 
programs can originate either on the client side in the Conn of now 
demands or the creative side in research and development in form c ' of new 
ideas , 

New programs or modifications of existing programs are then sent to 
the financial analysis unit or function. In terms of new programs, 
modifications of existing programs, or those ongoing programs that will 
not be changed at a] 1, financial analysis would make a forecast over 
some reasonable period of time, for example, five years, ns to the number 
of students who would be expected to utilize cacli program. In other 
words, financial analysis would brave to ascertain the size of the program. 
Given the number of students and given the technology of the program, the 
financial analysis can ascertain the required staff, space, equipment, etc. 
Financial analysis then, in turn, can formulate a program budget for each 
program. In terms of each program there would be certain expected out- 
puts in terms of numbers of students, program characteristics, output 
specifications of the program, etc. for example, if one of the programs 
ware math, with so many modules, one could ascertain the expected cost 
per student unit of output in terms of acquiring the requisite unit of 
math * 



Assuming that funds were not unlimited, the financial analysis \;ould 
have to carry out an investment analysis of all programs, both proposed 
and current. Presumably such investment analysis owuld be done in terms 
of attempting to maximize the decision function of producing more 
education with less cost. However, this will be done, and it will be 
explained in considerable detail in the section on PPRS, the financial 
analysis unit, on the basis of their review, would provide a set of 
recommended programs and budgets which would delineate the expected total 
program payoff in terms of the entire unit and in terms of individual 
program components. 

Assisting in financial analysis will be two basic sub-units - the 
information sub-system and the simulator. The information sub-system 
will be constantly storing basic data, client demand characteristics, 
program characteristics (particularly output specifications) , cost and 
resource data, numbers of students, etc. 

The simulator will also assist in investment .nalysis in which 
alternative allocation strategies in terms of program requirements will 
be ascertained and minimum costs searched for. While higher education 
has not reached the planning stage that one finds in the health field, 
with state, regional and local planning units that will assure improved 
economies of scale, such a simulator will assist in the determination 
of appropriate program size and the economic feasibility of each school 
or one specific school having certain educational programs. 
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Depending upon the arrangements of particular faculty senates at 
the school of education, recommended programs will be submitted to such 
a body by the financial unit. Or, if such recommendations do not have 
to be voted on by a faculty senate, they can be submitted directly to 
the dean and provost for budget approval . 

With budget approval, programs can then be implemented in the form 
of acquired requisite personnel, space, equipment, material, etc. Coir- 
current with such implementation, where required, new programs or 
modifications of existing programs will be promoted and/or explained to 
potential client users. Although programs have been developed in terms 
of client needs, clients may not necessarily know of their existence, 
when they are to be started, how they can take advantage of them, or the 
particular advantages of new programs over old programs. On the basis of 
such promotion, potential students will be made aware of the existence 
of programs and, presumably, will apply, at which time they will be 
picked up by system inputs, processed into a unit called student guidance, 
and, finally, processed through the educator. Student guidance v7i.ll not 
only have the responsibility of processing the student correctly through 
the educator, but will serve the control, function of assuring that, while 
in process, the educator is meeting the student's particular needs and 
characteristics. A scheduling sub-system will schedule faculty rooms, 
modules, etc. to process students through the educator. 

The educator, of course, represents the teaching process in the form 
of program delivery and execution . Upon program completion, a student 
is then placed, through the placement unit. 

The last function to be performed, and this may be performed by the 
sentry unit, is program review or a determination of actual program pay- 
off. It may be recalled that financial analysis, in recommending programs 
or drawing up its program budget, had a set of expected program outputs 
in terms of cost and client benefits. The question now is, was the 
actual program payoff the same as that which was expected. If not, the 
apparent error then is sent back to research and development to modify 
the program, or to financial analysis to correct. This reporting back 
to these two units closes the system and assures that programs will be 
modified or resources reallocated so as to meet client demands. 

In terms of the total management of such a system, it is apparent 
that an appropriate planning horizon lias to be provided for in terms of 
program development. Thus, while the sensory or intelligence units may 
note a changing client demand, an operational program may not be 
delivered for two or three years to meet such a demand. 

Organizationa l St ructure . In terms of the more traditional representation 
of the organizational processes one might look at Figure 4, MbTbP 
Organizational Structure. In comparison to the traditional academic 
structure it should be noted that it has within it a series of new and/or 
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with titles as with functions and task descriptions. And, if neces- 
sary, one might, for example, find an assistant professor who would 
be a financial specialist, devoting his entire effort to financial, 
analysis, or one might; have a full professor devoting all his effort 
and time Lo inventing new educational progr/nns . 

It should be apparent from the foregoing analysis also that pro- 
gram development in the METEF model will be on integrated process in 
terms of both the external environment as to client needs, running 
through the entire educational programming system to program reviev/, 
and then looping back to research and development for program modifi- 
cation or financial analysis. The tightness of the relationship be- 
tween all the sub-systems will be illustrated subsequently within this 
report. What will not occur, however, is the development of indivi- 
dual courses based on the interest, preference and competence of in- 
dividual faculty, with little rationale as to the interrelatedness 
between courses . 

The METEF system obviously is an open one and specifically pro- 
vides for an intelligence unit to constantly monitor potential 
clients and environment. Further, it operates in such a fashion that 
programs have to be developed and delivered in terms of client de- 
mand, 



As to the budgeting aspects of the mode.!, these obviously will 
be uuue in l&tms of output char actor is tics through a program budgeting 
process rather than the traditional way of making up a budget in terms 
of the budget input items. Instead of classifying resources in terms; 
of number of faculty needed, the amount of space required, etc., the 
budget will be determined in terms of numbers of units of output. 



More importantly, the budget will be allocated j.n terms of or- 
ganizational function. Depending upon analysis, if more funds are 
needed, for example, in the financial segment , then various staff 
would be put there; or, if a greater promotional effort is required 
in terms of more staff in the field, presumably budgeL v;ould be al- 
located in that particular direction. And, while the particular 
school or unit of a school may still be restricted in terms of legi- 
slative budgetary ratios as, for example, for every increase in 
fifteen student majors, the school will be entitled to one profes- 
sional personnel, the internal management of the school will have to 
reallocate such a budget so as to be able to effectively execute all 
of the sub-systems in the organization. It would no longer be an 
automatic allocation of funds into a teaching function, in other 
words, it would not necessarily hold to a fixed ratio of a teaching 
function of, for example, thirty students per faculty man. Or, as 
one implements the METEP program and moves from a traditional orga- 
nizational programming process, which is largely academic in nature, 
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changed functions. One may recall that the traditional organization- 
al structure was organized along disciplinary lines, or one nay have 
an elementary education unit, a secondary education unit, etc, within 
a school of education. Within any one of these units, for example, 
elementary education, this might break down to a math unit, a social 
studies unit, a literature unit, etc. 

The new functions which derive from the previous analysis are: 

1) client analysis or intelligence unit; 2) the information sub- 
system; 3) financial analysis with simulation; 4) promotion; 5) per- 
sonnel; 6) space and equipment; 7) research and development; 8) quali- 
ty control, and 9) flexible scheduling. In terms of administrative 
structure, one would have not only a director of the elementary unit, 
but an administrative supervisor to administer what are generally 
within the academic setting considered administrative functions, and 
an academic supervisor to supervise that might be vievred as academic 
functions, although Lhe distinction being made is quite arbitrary. 

Char a c ter is ti cs_ of liKTKP Educa tion a 1_ Pj : o.grn m n tin g 

System and Orgauixational F ro ces s lug, Terms . In terms of organization- 
al structure, function, and process, the closest: analogue to METEP 
would be the modern non-profit enterprise. Instead of a single func- 
tion - teaching - one introduces organizational specialization and 
differentiation. Program development is no longer an individual un- 
dertaking of a single faculty man, which is the guild concept, but is 
a total organisational effort. One introduces differentiated func- 
tions within the organization. The striking characteristic of the 
traditional organizational structure of either schools of education or 
universities is that they are so primitive in the sense that they 
basically incorporate: a single function — that of teaching. This might 
be similar to the very early business enterprises that had one func- 
tion— production* or the very early hospitals that had a single func- 
tion--nursing. However, as one views the history of the development 
of organizations, what is striking is that with this development comes 
increasing functional differential ion and greater specialization , 



With the introduction of nevj functions, of course, one would 
have to develop a differentiated staff to perform the various func- 
tions. Training qualifications and rewards of the staff would have 
to fit the functions Lo be performed. Within the METEP model one 
would, for example, want a financial analyst to work full time in 
forecasting, program budget, preparation of investment analysis, etc. 
Or, similarly, given the unique qualifications of the individual., an 
individual might work full time in research and development in the 
creation of new programs. In other words, one would not have a sin- 
gle role of professor, who is currently expected to do every tiling. 
While it may be necessary because of university restrictions to main- 
tain the professorial role structure in the form of assistant, as- 
sociate, and full professor, this analysis is not so much concerned 
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one begins to build up other functions, and presumably the organiza- 
tional budget would have to reflect such a development. 

If the educational process is to become more productive, the 
amount of resource devoted directly to a teaching or educator sub- 
system lias to be reduced. Or, over time, if all the oilier Hub-systems 
operate effectively (finance, R & ]), promotion, evaluation, intelli- 
gence, etc..), they should develop programs that provide more effective 
education at reduced costs. Thus, over time, the teacher-student*, 
ratio in the educator should increase from 30 to 1 Lc GO to 1 or 370 
to 1, while, at the same time, the educational output is improving in 
' ne form of a better product. The holding to fixed teacher ratios 
precludes the possibility of introducing improvements into the system. 
Industry, over time, lias been able to deliver better products at less 
direct unit labor costs. The number of employees in manufacturing 
has been going down for years. The reason that this is possible is 
because of the effectiveness of other sub-systems — finance, industrial 
engineering , engineering, marketing, etc. 

Turning once to the fundamental problem of developing an 

adaptive and responsive educational programming system, certainly the 
METEP model eliminates the def iniencies of the traditional and con- 
stitutes an increment in the state of the art. The METEP model is an 
open system in terms of environmental demands and changes. It will 
naturally and automatically respond to client demands and programs 
will he developed in terms of these client demands • This is assured 
through the development of new organizational functions and processes. 
No longer will one have a static, non-responsive system divorced from 
the society of which it is a part. The METEP model represents an at- 
tempt, in terms of organizational processes, to move the university 
into the twentieth century by changing it from a guild system, which 
is essentially Medieval In orientation (a fact in which many faculty 
incidentally, take great pride) to an organizational form that more 
nearly characterizes our more modern organizations. 

The proposed system will also provide a set of benefits to all 
of its various clients; it is concerned with educational, economic, 
and social values in addition to the traditional academic values. 

The relative academic standing of the system or the particular acade- 
mic reputation of the faculty is not necessarily of overriding con- 
cern. One of the underlying assumptions of the METEP system is that 
schools of education exist to serve society rather than society ex- 
isting to serve schools of education. Further, a considerable 
measure of con summer sovereignty is provided in the system on the 
assumption that clients, be they students in the program, public 
school children, parents of children in school, or public school 
teachers, know perhaps better than anyone else what their best in- 
terest is. The concept of M the professional educator knows best" in 
terms of how society ought to operate, what students want or should 
want, what parents should put up with or what they should pay is 
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being SGriourJy questioned . Our unfortunate experience has been Unit 
when we penult: one group t o dote} mine what is bent for al l other 
groups they tend to devise a system which enhances their own profes- 
sional interest. 
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The Management Sys tom 



On the conceptual level, how will the management syst ok he inte- 
grated with other systems or how can we assure some cowpat Jhi li ty 
between tins Management system and the other subsystems of MET!'?? See 
Figure 5, Management System in relation to other oyster, in MEfFP . In 
our previous functional analysis, one can assume that there will exist 
a client and environmental analysis unit, a research and development 
unit i a financial analysis unit# a consensus unit# a promotion unit 
and so on. Let us further assume that as we look down the road, these 
are ongoing, operating functions. That is, let us suppose five years 
from now, there exists within METLP, a staff or a function that per- 
forms extensive client demand analysis. Still another function, re- 
search and development would be doing extensive work in new education- 
al program developments, etc. It is further assured that in charge of 
each of these functions is a manager or an individual who will be 
assigned responsibility for solving any organizational or KETFP pro- 
blems that might arise either within these functions or between these 
functions. Thus, we might have a market research manager, an engineer 
ing manager for research and development, a financial manager for fi- 
nancial analysis, a consensus manager, a promotional manager, etc. 
These need not be separate individuals. As a matter of fact, you may 
have because of the size of operations only one or two. Ue are only 
delineating the managerial function at tills particular time. Let us 
further assume that within five years (and here we arc viewing the 
METEP Model as an emerging system) a fairly clear set c/f expected out- 
puts with rather definite output specifications will have emerged in 
terms of client demand analysis, as part of the expected output we may 
expect within the school system. And that is where, for example, Span 
ish American parents want Spanish introduced in the schools, etc. 
Further, on an input basis, the client demand analysis unit lias been 
funded to carry out ethnic analysis at the parental level. 

A similar stage would exist insofar as the other functions were 
concerned, i.e., R and J) would be funded to produce two or three new 
education programs every year, perhaps one in the language arts, media 
or social studies, Financial analysis would be programmed to produce 
various kinds of investment alternatives in terms of proposed R and D 
programming projects. 

We further assume that five years from now we would have a moni- 
toring or auditing unit which would be able not only to audit program 
payoff but functional payoff. This unit would be able to measure t lie 
actual output of such operating functions as client demand analysis, 

R and D, financial analysis, consensus, etc. Obviously errors would 
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be generated Imre in that the difference between actual and expected 
output would re.pro.acnt sysUm failure at the subsystem level. Such 
systems failure at the subwy.stcms level would feed into the management 
system and be assigned, depending on where such error originates, to 
the manager who is responsible for solving problems i elating t.o that 
particular function. One may find defects in the wanner in which client 
demand analysis is carried out vis a vis, for example, ethnic groups; 
that is, the wrong data or conclusions were drawn from such analysis. 

One will find in certain research and development or program dee ign 
where Lite defective programs were designed or incorrect investment anal- 
ysis were made. It would be the responsibility of the manager in charge 
of these areas to correct subsystems failure. Thun, the problem will 
come into the management system, a solution would be devised, v/ould be 
inserted into the function, (See Figure 5) . Finally, the solution 
would be audited and presumably the actual expected output would then 
be equal and the problem would be eliminated. 

If one views Figure 6, MF/JTEP Management System - Example, we sec 
the management system generating a solution in somewhat greater detail, 
with the initial problem being generated from a source other than the 
monitoring or auditing unit. Presumably, the management oystc-ni is go- 
ing to involve problem raising on the part not only of its monitoring 
unit, but various groups that would be involved in the system such as 
faculty, students, deans, staff, perhaps government officials, employ- 
ees, etc. Tins, as we see a student flowing through the .system, he may 
be unhappy about guidance or the educator 01 the manner In which he lias 
been placed and he may complain, which then would generate a problem 
which would feed Into what would be a problem raising mechanism vfuicb 
would pick up effectively his complaints or concerns with any part or 
any subsystem of the total MKTKP system. These problems would go to 
the coordinating unit. The; problem v/ould be assigned to the manager 
in charge of that particular subsystem - it may be student guidance, 
the educator, placement, or v?hat have you. The problem solver v/ould 
generate or devclc* a solution which would, if necessary, go through 
consensus and authorization, the solution v/ould then be implemented 
and one notes here it feeds back into the operating subsystems , the 
solution is then subsequently audited in terms of its expected con- 
sequences. 



In terms of estimating costs of the management system live years 
lienee, this would be largely speculative in nature. However, if one 
looks at Figure 4, MKT HP Organizational Structure, in terms of rather 
traditional organizational analysis, the assumption here is the admini- 
strative segment v/ould consist largely of three full-time individuals 
plus some part time effort on the part of such systems such ns client 
analysis, information, financial analysis, simulation, placement, etc. 
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The assumption is also made that the MKTEP Model w ill have to carry 
its entire management staff, that is, in terms of functions to he 
performed or that those functions should not be centralized in the 
school of education. If they v?cre centralized, then presumably the 
administrative sequent might be spread over programs in addition to 
the M):m> Program as an overhead item and thus reduce its costs. 

Since it is not clear at this lino cither what the untune of the or- 
ganisational structure of the entire school will he, figure 4 , in terms 
of organizational structure appear:.; to he reasonable. In other words 
the budget will have to provide for at least three full-time adminis- 
trators and a significant portion of part-time adnini stratum. 

It's fairly apparent in order to estimate the future cost of a 
management system and to develop a budget for such a system one lias 
to know within a given time period the total number of problem:; which 
the management systems would have U> solve, the average time it tubes 
to solve a problem, and the average cost per seme time unit. Vims, for 
example, if in requesting funding for the management system for next 
year, fiscal year 1970 or ’71, if we, for example, knot: in that time 
period that 200 problems would arise over the year and that each pro- 
blem on an average took 20 hours to solve; this? would mean that wet 
would have to budget 4000 inun horn s of nan gcrial tin re. Assuming 
that managerial time costa $10 an hour in direct labor costs, insofar 
as th e system is concerned, we would then request a $40,000 budget. 

However, we are at the initial stages of sotting up tbo pr^gc- 
ment system and ultimately in order to develop the kind of budgeting 
that has just been no tod, extensive document at ion in the form of 
ledger, control hoards, ferns, production schedules, delineation of 
v/hal is to be considered managerial lime would have to be established. 
In other words , the whole area of measurability in terms of the man- 
agement system is currently being worked on and no historical data 
exists, so that no forecasts can be made as to potential problcn de- 
mand on the managerial system. It should be noted that the rough 
estimates made above os to budget inquests are consistent with present 
accounting practices which view management as part of the overhead 
and as such provide very little operating guidance as to number or 
type of managers. Thus, even with this rough approximation, it is 
consistent with the present state of the budgeting art. 
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FLANK FI) EFFECTIVE DECISION INKING 



The entire Ml'TEP Mode] is viov T ed ns a learning system or one 
which on the basis of its experience can self-correct its operations 
so as to make ru.ue productive, however, productivity is defined, The 
management subsystem is no exception, in that a management redesign 
capability would he considered a permanent pari of the METCF Model or 
tlie management system of the MfcTLP Model in the form of organ i nati onal 
planning. Thus, if one looks at Figure 7, Node sign of tne Man- 

agement System, one finds basically three subsystems. One, of course, 
would be the operating sysLcm v:luch is the School of Education v;hich 
will generate certain operating problems which are fed into the man- 
agement system and solutions me generated Lo correct operation. Tins 
has nJ ready been reviewed in Figure 5 and 6 of iliis report and Figure 
2 of previous Final Report. Viewing Lhe MLTKP Model as a fully deve- 
loped one, let’s say five years from now, at that tine there would 
exist n certain expected value output f a v om the point of the management 
system boll) in terns of the quantity and the quality of relations pro- 
duced. One may find, for example', that an error may exist in the 
management system as the actual value and the expected value of the 
system may be considerably different. Those, then, would constitute 
management problems and would fit into the organisational planning 
unit that would be concerned in the main with devising administrative 
solutions which would feed back Into the management system and hope- 
fully would correct, management system deficiency. 

T n a very general way v:e flight review how current redesign of 
management system might operate. Starting villi the School of tduen- 
tion at the bo l Lorn of the chart ve fright look to expected value of 
output on some time unit basis. Suppose in the MLTLF Model one is 
looking at tlie language arts program and we arc dealing with KBT1P 
here ns being essentially a programming producing unit. Let us 
further assume that the METlIP market in its largest sense constitutes 
tlie 25,000 local school ayslcns in the United Slates and the 30 
million children in grade school, bet us further assume in setting 
up for the next two years starting with January of 1970 that K and 1) 
and language arts will produce new pedagogical techniques that will 
result in an improvement of 15% in reading capability on the part of 
the average child, liCt us further assume that as an objective with- 
in the next two years this new pedagogy can be implemented or that 
at least 2 million children will be affected, bet’s further assume 
that a currently average cost of current teaching of reading runs 
about $200 a year and thus ^ver Ihc next tw years the expected value 
of the language arts program in saving money would be 400 nil lion 
dollars in Iwo years of 2U0 million dollars in one year. Or to re- 
phrase tills, in terms of R and D in the School of Education, value 
of the invention is 200 dollars per child and vc’re going to affect 
2 mil 1 ion chi 1 Jren . 
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However if, in terms of this program, instead of achieving ex- 
pected values of 400 ini 11 ion dollars over two years or 200 nil 3 ion 
dollars per year, one received 50 million dollars a year or a total 
of 100 million dollars a year? An error would exist between actual 
and expected value of approximately 300 Million dollars. Obviously 
in our operating systems there must be considerable error problems or 
subsystems failure or v:e wouldn't have such differential assuming these 
problems are being fed into the management system, being into subse- 
quent tine periods then in terms of expected value of solution output 
or management system output we then want this management to reduce 
this 300 million dollar error in Lhe operating systems. A \ us we might 
have as an expected value of the management system of solution output 
per year 100 million dollars which means in tlu* subsequent three years 
the error of 300 million dollars should be eliminated, boohing again 
at the* operation systems of the School of Uducnti.cn at the end of the 
five year period the expected value of output is 400 million dollars 
and actual, value of output should be also 400 million dollars. 

bet us suppose that at a subsequent tine instead of expected 
value solutions output* of 100 million dollars per year, one achieves 
the actual value solution output, of about 50 million dollars a year 
(see Figure 7). Ibis error now constitutes managerial or administrative 
problems or errors in the management subsystem vrhith is generated into 
organizational planning which in turn must delineate certain binds of 
solutions in order to ultimately eliminate the error or system. 

Returning once again to the initial problem where one lias an 
exported values output of 200 million dollars and actual value output 
of 50 million in the language .arts program this error is fed back into 
the management system. There nay exist in all the subsystems defici- 
encies causing this error. Thus the client demand analysis nay have 
overcs timted the demand for new pedagogy in language arts, The en- 
gineering section may have made errors in terms of Lhe productivity 
of the technique. It nay not have actually increased reading capabil- 
ity 15% once introduced in the field, hut only 10a. Finance may have 
made errors in forcasting how quickly one could gear up to deliver 
the system to various school systems. The marketing and promotion 
people may have been optimistic about hew rapidly they could intro- 
duce this into school systems and made errors in their analysis, or 
they estimated they could deliver and implement n program for 2 million 
children a year and perhaps more realistically it should alive been a 
million and so on. In other words the fact that ve have a gross error 
in the language arts expected value over a two year period of 300 mil- 
lion dollars is really only symptomatic of a series of errors or de- 
ficiencies they tray exist in all the other subsystems which taken 
together aggregate 300 million dollars over the two year period. 
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ESTIMATED AGGREGATE VALUE OF METEP AS A DIFFERENTIAL IMPROVEMENT 
IN THE STATIC OF THE ART OF EDUCATIONAL PROGRAMMING 



It may be recalled that it was suggested that the METEP Model 
constitutes an improvement in the sLate of the art ol education.!) 
programming systems. It is definitely an improvement in the state of 
the art of producing and delivering improved educational innovations. 
Let us consider the METEP Model ns a basically It and D shop that de- 
velops and delivers new and useful educational programs. In terms of 
demand analysis versus potential payoff of new programming which the 
METEP Model is geared to produce , assume that demand analysis finds 
that 30 million children in grade schools spend an equal amount of 
their time in grades 3 through 12 in language arts* social studies, 
math and science. On a per child per year basis assuning that the 
cost is now running about 600 million dollars a year (and this would 
be) for 30 million; about 150 dollars per child per year for each of 
the programs - science, math, social studies and language arts. Our 
current expenditures on these programs is 18 billion dollars a year. 
Thus 18 billion dollars would represent the total potential program 
market. Let us suppose that one could develop an educational or tech- 
nological programming system which in the language arts could improve 
the teaching of reading 10% and install this improvement throughout 
the country in five years. Such improvement over the five year pc-* 
riod would represent a 400 million dollar caving or improvement in 
teaching. In terms of different organization?*! or administrative pro- 
cess one should bo. able to measure the total educational consequences 
in terms of the development aid delivery of new educational techniques. 
One is more likely under the METEP Model to develop, deliver ennd in- 
stall new educational programs than you are under the present state of 
administrative and organisational development in the educational field. 

Based on the guild organization already noted, schools of educa- 
tion are not organized to develop and deliver new and improved educa- 
tional programs to local education systems, that will result in 
significant improvements in these systems. 
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FEASIBILITY OK AN EMERGING MANAGEMENT SYSTEM 



The management component of 1 1 1 e METEP model has been described 
as a tv:o part process of organisation development , implementation and 
redesign over a five year period. Nov; and improved existing organ- 
ization functions were recommended (c.g., client demand analysis, 
research and development of education prograins, new program promo- 
tion and PP1» in the financial function) in order to prevent newly 
generated programs from receding in time into the ranks of the well- 
established and eventually frozen in a form which is net responsive 
to clients- or the environment they were intended to serve. Tills part 
of organization development is to be notched with the concurrent 
emergence of a planned effective decision making process which will 
hereafter be referred to simply as the management: system. As; has 
already been conceptualized as an organization problem solving pro- 
cess (see Figure 3), it is the latter - the management system - that 
we are primarily concerned with in this discussion. 

The problem at hand is, of course, whether or not the management 
system that emerges over v. five year period can feasibly solve the 
organization problems that the MKTEP model will generate. Although 
our initial tost system is necessarily based on a set of highly 
arbitrary standards and assumptions, ve. believe for the reasons 
discussed earlier in this section that the suggested conceptual model 
is a feasible point from which to begin. .Since v;e rely heavily on 
redesign of the initial tost system over a five year period, C he 
feasibility of the management system as it emerges can realistically 
be ruled on in terms of economic, human and technical limits actually 
imposed throughout the implementation period. 

We believe the most glaring design deficiency at this point in 
time to be lack of roeosurnbili ty of the initial test system,. In 
terms of the prototype system lecomr. ended herein, metrics is several 
stefs behind conceptualization. The system designer's ability to 
rule out infeasible model alternatives depends critically on the 
availability of historical data on the pcrfonnance of the management 
system as if emerges. An essential part of providing some assurance 
of maintaining feasible design is, therefore, the provision during 
implementation of the neons to generate historical data which is 
required as a basis for redesign. The importance of tne measurement 
problem can be seen against the background of monetary, human and 
technical constraints within which the system will emerge. 

fitid^ta ry Ke st riot ions. Management costs (in the sense of manage- 
ment problem solving activities) are appropriately part of education 
program costs with the quantity of solution outputs (decisions) gen- 
erated by the system. Organization problem input and solution out*- 
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put volume is in turn related, in presumably measurable ways, to 
changes in program (s) size from year-to-year and to changes in 
variety or mix of education programs over Line. As discussed 
earlier in this section, the future expected costs (over the five 
year period) can be obtained through knowledge of the total number 
of problems the management system would be expected to solve, the 
average time required for various types of organization problems 
and the average cost per lime unit. 

Ell£?onnel . l-nder the major premise that v;c can approach reasonably 
systematic management of decision making in the Jli-TKr organization, 
we must not only rationally allocate problem solvers over the pro- 
blems to bo solved, but lo do so within restrictions imposed by the 
quality and quantity of managerial personnel. Infeasible system 
performance can be caused by deficiencies in management performance 
rather than system design. Indices or measures of skills required 
and of current managerial performance must be developed in order to 
distinguish between design infensihilivy and infeasibility associa- 
ted with management skill deficiencies. If foresight is applied to 
system measurement, this is a basic data problem which can provide 
the informative detail (through essentially qualitative measures) 
needed to evaluate, the more productive alternative uses of current 
managers in problem solving as well as forecasting personnel re- 
quirements. 



technical KusiidicL iuns . In addition to human Hr »1 La L ions , the 

quantity and quality of solution outputs generated by the management 
system depends on the ability to specify the management information 
for problem solving required, in advance of the ncccU This problem 
of the kind and variety of rnnagerr.cnt information must be searched 
and judged in terms of cost/ef f ectiveness and villi in the technical 
limits imposed by Lite concurrently emergent capabilities of the 
management information sub-system and the range of data and reports 
it can feasibly provide. Tills general problem v?ill be referred to 
again in Section III - Information Systems. 



Ini ti al Test Design Measurability. The general system measurement 
problem touches not only the problem solving itself, but also the 
design of all monitoring mechanisms associated with the outputs of 
each functional activity in the organization and with the retrieval 
of external intelligence data from the various client groups. Our 
attention in this discussion, however, is given to the measurement 
problems associated with the management problem solving and its 
solutions . 



Documentation (nature of the problem solving process) . The ul linate 
achievement of an elevated model requires that the nature of the 
organization’s problem solving tasks be specified as the tasks, or 
steps, involved. Tills has already been specified conceptually (see 
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Figure 3), but noL in terns of precisely what steps various types of 
problems raised will foliov; or v:!mt *.,* ill be Lise procedures followed 
at each point and v:ho will have or shave rospensib i 1 i Ly for perfor- 
mance. For example, some problems nay bypass author! zn t i on because 
Its expected .solution nay require little or no allocation of I'iirnv* 
cial ur other resources* Or, certain problems and solutions devised 
nay not jointly involve or affect other r Hungers or functional acti- 
vities thus perhaps el iminnti ng the necessity of running solution 
alternatives through lae organisation concensus functions. Certain 
problems may bettor he processed where the sequence of authority and 
concensus may usefully lx? reversed. Moreover, wc can anticipate 
problems of day-to-day operating nature that nay very well, avoid 
the entire organization problem solving process and remain fully 
decentralized and in the control of the particular manager of the 
functional area involved, We would also expect certain problems to 
be of repetitive nature for which on acceptable solution nay in a 
certain seme become a programmed solution and therefore solved only 
once. Under the assumption then, that the system designer can learn 
to specify the detailed nature of the problem solving steps arid 
improve the process in terns of sequence, and the organization 
problems associated with a sequence, the integration of organization 
problem solving activities can be feasibly planned over lime. Given 
human, monetary and technical resource limits that will arise, the 
nccU'hulat ton and analysis of such basic data should peririt sufficient 
control over the u*st model as veil as the. potent! til i.Cuiij to maxi 
nizc the volume of solutions outputs and to minimize average time 
while increasing the value? of solutions over time. 

What is inquired at the tine of implo.ncnLnl.ion is a simple, 
inexpensive fern of problem processing documentation which would 
serve as problem scheduling and control tests. Facsimiles of such 
tools are shown in Figoies 8 and 9. Using Figure g as a guide, 
the raster control board would be maintained in the control unit, 
or by its coordinator. As problems arc initially raised, either 
through monitored outputs of operating functions, externally raised 
problems, or by the organization members, each would be documented 
and specified as to problem definition, the nature and likely cause 
and when possible, the specifications of the expected solution. 
Written, recorded problems would be assigned, in most cases, direct- 
ly to the manager concerned, assuming cf course, a programmed solu- 
tion docs not already exist. Documentation, scheduling and control 
throughout the problem solving process as indicated by items in the 
master control board would permit "problem runs" to be actively 
managed and analyzed In order to reveal opportunities for system 
redesign if necessary. Historical data on "test runs" should reveal 
to the system designer whether or not the test system will perform 
reliably, that is, solutions will be generated within an acceptable 
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range defined in terms of volume, cost snvi value of solutions. Mea- 
surability, moreover, must also permit the designer to rule on the? 
stability of the system ns program size changes, or organization 
structure changes or unexpected surges in problem input volume occur 
and still maintain a relatively stable state of solution output. 

The ultimate emergence of an organization planning function 
described earlier will provide the essential integrating function, 
or management of the management system. Tills 1 unction is an innova- 
tive way to reconcile the needs for specialisation in the KF/J.'EP or- 
ganization V7ith the need for integration of total organization effort. 
Assuming that over the five year period the actively managed manage- 
ment system can develop expected solution standards, and given the 
achievement of system measurability, this organisation function, as 
explained earlier, provides the device for controlling the management 
system in terms of the quality and value of its solutions. 
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Management: As An Emerging System 



Given a five year development METEP Program, what will be the nature 
of planned management development in thir time period? In order to an- 
fiv/er thin question v?e might consider three sub-questions: 1) what is the 

nature of our present managerial capability, 2) what type of capability 
do we want to develop, given the rationale or overview in terms of a 
total educational programming system and 3) how v;ould we determine 
whether or not we have achieved our managerial objectives in the five 
year developmental period . 

Present Management _ System^ nn_d_ J^uj\c tjLj>jis__ o/_ JILT KP . One would logically 
expect that the nature oi the managerial thrust would reflect in large 
measure the nature of the organisational function to be managed. The 
METEP project reflects this phenomenon. METEP has been essentially a re- 
search and development effort. The most appropriate type of management 
for such an effort is what we have come to call project or program 
management 

We might briefly look at what a research and development function 
is in an organizational context, as distinct from a financial function, 
a personnel function or a client demand analysis function. The purpose 
of the research and development effort is to produce productive education- 
al innovations or programs — to improve the state of the pedagogical 
art. Such a research operation usually consists of a series of small re- 
search teams working in particular arena on specific educational pro- 
blems. This has been the case with the METEP project and thus, in the 
pedagogical area: one finds a team working on Language Arts, another 

team on Human Relations skills, and another team on the teaching of Math- 
ematics, and so on. In addition, one finds teams working on simulation, 
information systems, management systems, et cetera. Although the first 
phase of the METEP Project is concerned with planning or design, it is 
hoped that these plans and designs will be innovative and productive. 

The cliarac teristics of the management of such a function emerge in 
large measure from the nature of the research and development function. 
Because the essential output of this function is productive educational 
innovation - it is important that the manager of the project encourage 
and develop a free and creative environment for the researcher, in order 
to ensure a high productivity of educational innovation. The nature of 
the managerial process concerning the research and development function 
can be determined in part from noting the nature of the creative process 
itself . 

Concerning the creative process, Anne Roe noted, 

"The (creative) process is intimate and personal and char- 
acteristically takes place not at the level of full consciousness 
but at subconsciousness or preconscious levels. Many effective 
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scientists and artists have learned a few techniques which may re- 
duce interference with it hut no one to my knowledge has discovered 
any means by which lie can set it in motion at will." 

It is probable that the fundamentals of the creative process 
are the same in all fields, but in those fields in which advance 
in knowledge! is necessary there is an additional requirement - tills 
is the need for a large store of knowledge and experience. The 
broader the scientist's experience and the more extensive Ills stock 
of knowledge, the greater the possibility of a real breakthrough, 

The creative process involves a scanning or searching through 
stocks of stored memories. There seems to be a rather short limit 
to the possibility of very significant advance through voluntary, 
logical scanning of these stores. For one thing, they vary en- 
ormously in their accessibility to conscious recall and In the 
specificity of their connection, so that reliance upon conscious, 
orderly, logical thinking is not likely to produce many results at 
this stage, however essential such procedures may become later in 
the verification. This scanning is typically for patterns and com- 
plex associations, rather than for isolated units. It' may be, how- 
ever, that a small unit acts as sort of a key to the pattern. What 
seerns to happen, in creative efforts in science as well as in 
every other field, is that the individual enters a state in vfhich 
logical thinking is submerged and which thought is pre-logical. 

Such thought is described ns rambling largely because it typically 
tries seemingly illogical and distantly related materials, and it 
often makes major advances in just this way. It is not fully ran- 
dom, however, because it is goal-directed and because even in tins 
preconscious work there is appropriate selection and rejection of 
available commcctions . This stage of the creative process is ac- 
companied by a generally confused or vague state of preoccupation, 
or varying degree of depth; it is well described as ’stewing’. It 
is this stage which apparently cannot be hurried or controlled. 

Although termination of this stage (finding a solution or 
’getting insight’ as it is often called) quite frequently occurs in 
a moment of dispersed attention, it apparently does not help to 
induce a state of dispersed attention in the hope of provoking a 
quicker end to the process. It should be added that while insights 
do frequently occur f in a flash 1 , they need not do so, and that the 
process is the same whether or not the insight turns out to have 
validity . ^ 



In "The Psychology 
Obler and Herman A. hstrin. 



of the Scientist 11 , The jtew Sc 1 cn t i s t , Paul C. 
I2ds . , (Garden City, N.Y., 1962) pp, 86-88 
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Given the nature of Lhc creative process what type of organizational 
environment is believed to be most productive? 

Professor Orth has suggested five basic components of a creative in- 
dustrial rescarc.1i climate. The first is the necessity to accept l lie 
status of the researcher. This involves permitting considerable freedom 
to the researcher in the decision making process concerning the research 
activity, and also the acceptance of the researcher as an equal. The 
second basic element for a creative research setting is appropriate fa- 
cilities and assignments: specifically, good laboratory facitilites, 

colleagues of high professional stature, and work assignments of interest 
to scientists. An other factor concerns the relationship between the 
administrator and researcher. Highly creative scientists do not con- 
sider themselves as employees, but rather as professionals . As such, 
they believe that they should be served by the organization tor which 
they work, rather than be regulated by them. 

Another characteristic of a successful industrial research climate 
is the opportunity for mobility along the continumm - from basic research, 
through applied research, to development by the researcher as his or- 
ientation and interests change. 

The final important characteristic r.oted by Orth et al. is the need 
on management’s part to recognize the importance of research effort. ^ 

While final judgment cannot be made at this time as to how innovative 
the METEP effort has been, both in terms of the quantity and the quality 
of educational innovations suggested in all of METEP 1 s dimensions, there 
is little question that there has been a conscientious, consistent at- 
tempt on the part of the management of the School of Education, (par- 
ticularly as it relates to this project) to create an organizational en- 
vironment that would maximize innovative output. The present leader- 
ship style is entirely consistent with the desired managerial R and D 
model noted above. Researchers have been encouraged to be as free as 
they like. New ideas were encouraged and no matter how far fetched, 
initially, were given serious consideration. Researchers were encouraged 
to innovate through the search and exploration of possible avenues 
which fell outside of the traditional educational approaches and/or dis- 
ciplines. It was a deliberate managerial strategy to avoid early 
closure, or to move too early to freeze design, which might preclude 
significant innovation. 

Thus, the mission of the project and the style and techniques of 
management of the project were always kept in mind to produce effective 
educational innovations. For the most part, each research team was 



? Charles Orth, John C. Bailey, Francis W. Wole.lt, Administering 
Rese arcli and Development , (Homewood, 113., 1964), p. 336. 
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granted considerable freedom in terms of developing that product which 
the research team felt was best. The managerial effort was directed 
toward creating appropriate facilities, and providing stimulating col- 
leagues of similar interest. Underlying the managerial effort of the 
project, has been the commitment to the idea that if we are to have a 
better, more productive undergraduate program in education, it will have 
to be invented. 

Emerge nc e of H KTEP a s an Educ ati onal Programmin g System. The second 
question is, where do we go in the next five years? The basic question 
to be answered related to planned organizational growth. Specifically, 
what organizational functions should be developed, in addition to those 
which presently exist? The basic function which currently exists is 
production or teaching. The educator, the research and development 
function is currently evolving. 

In the next five year period, in order to develop a total education- 
al programming system, in addition to a research and development and ed- 
ucator function, it will be necessary also to develop a client demand, an 
alysis function, finance, personnel, space, consensus, promotion and 
delivery, and finally, program review. To have systematic and planned 
growth, these functions must be introduced. What stages are logically 
required for developing the additionally needed functions? At the out- 
set, permanent functional managers must be obtained. These individuals 
would be responsible for the designing oc planning of how a specific 
function is to be executed. For example, the financial manager has to 
plan or design how budgets are to be put together, programs defined, how 
investment decisions are to be made, hew budget data is to be scheduled, 
coordinated, and so forth. 

Besides planning, managers of these additional organizational 
functions implement the plans. They organize potential staff and hire 
trained personnel to execute the planned function. In addition, the 
managers supervise day-to-day operations to resolve incidental problems 
that may arise and finally, they control or monitor the function to as- 
sure that it performs or produces as expected. Insofar as the organ- 
izational functions are concerned, it is assumed that over a five year 
period each of the organizational functions would have a set of expected 
outputs. Thus, viewing the research and development function in any 
given year there would be certain expectations as to the number and 
quality of innovations to be produced. Financial management would have 
a set of expectations as to the amount of money that might be saved 
through effective financial analysis. Similarly, promotion function 
should have an expectation as to the number of innovations introduced 
in the school systems. And if these expectations were not met, this 
would create a managerial problem which would be fed beck to the manager, 
who would review his work either in terms of design staffing or in 
terms of functional objectives, to assure that in subsequent time periods 
functional objectives will be achieved. 
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This, of course, means that as additional functions are added to 
the METEP effort, managerial staff will move from essentially a project 
management motif or style, to a multiple, management function. Specifically, 
in terms of managerial capability and staff, the project lias to fund, 
in addition to research and development which currently exists, ad- 
ditional management for augmented organizational functions. Once this 
happens, it is reasonable to expect that by increasing managerial dif- 
ferentiation , ultimately a new managerial function will be introduced: 
the management of the managerial function itself. 



Time Proj ections, llow long will it take before the additional functions 
become operational? This depends of course, on the. size of the functions, 
the number of employees and the problem solving load within the function. 

In terms of time sequence, assume that it will take approximately 
six months to find and hire qualified functional management. Further 
assume that they will devote at least one year to the planning and an- 
alysis of their functions. It might then take them six months to im- 
plement their plans, which will relate to organizing, staffing and ac- 
quiring the resources needed. Plans have to be approved through the 
consensus and authorization steps, Thus, additional organizational 
functions, in terms of finance, client demand analysis, program review 
or program promotion, etc. might not be operational for at least two 
years. However, given a five year development plan, operational 
functions can be monitored for the last three years cf the program, so 
as to improve functional productivity. 

In terms of managerial selection and development, the next im- 
mediate stage is to find qualified managers for the organizational 
functions to be created. It would seem at the outset, that one might 
concentrate upon functional skills, rather than disciplinary skills. Al- 
though the administration of an educational operation is important in- 
sofar as management of the specific functions is concerned, the pro- 
fessional educator would not be recruited as a manager or administrator, 
unless that person has the requisite functional skills. Therefore, in 
hiring a manager to develop the financial area, the concern is es- 
sentially for a manager with financial training, experience, and skills. 
Such an individual may not emerge from the field of education at all. 

Once there has been a decision as to what functions are to be de- 
veloped, there follows the problem of developing position descriptions 
for managers, delineating both the task that is to be performed and the 
qualifications necessary to perform this task. Such position descriptions 
amplify the organizational chart and structure of the METEP project. For 
example, in hiring a promotion manager, an individual who had training 
and experience in public relations, advertising, media, selliig, and so 
forth would be sought. 
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How to Assu re Manag erial Objective s Are Hot, Given the time projections 
noted above, the new functions will become operational in approximately 
two years. In operation, the total managerial system will be monitored 
as noted under section, "Plan Effective Decision Making", and specifical 
ly Figure 7 of that section* Or, given the objective function of the ed- 
ucational programming system, over time, the managerial system has to 
produce a solution output in terms of that designated objective function. 

For example, if one of the requirements of the total educational 
programming system is to reduce the cost of training, presumably a 
solution output over time will effectively do this* If another ob- 
jective function is to produce effective educational innovations and 
deliver these to the school systems across the country, then, the systems 
solution output will contribute to that educational objective. A 
system will exist to monitor functional managers to ascertain the ex- 
tent to which their management solution outputs are contributing to the 
total educational programming system. 
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Figure 10 Generalizing the METEP (Two Organizations) 
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*5* (Back to School of Eaucation) 



Generalizing the Model Elementary Teacher Education 
Program Model - A Two Organizational Analysis 



The purpose of this section is to illustrate how the Model Elemen- 
tary Teacher Education Program (METEP) Model and its organizational ad- 
ministrative features can be generalized and applied to an array of ed- 
ucational settings. Specifically, the attempt will be made to illus- 
trate how two educational organizations, the school of education and any 
given local school system can be coupled by using the METEP Model (Sec 
Figure 10). In this illustration, one of the basic functions of the 
school of education is to develop or invent and deliver new, improved ed- 
ucational programs. (Other terms have been used insofar as the function 
is concerned: social and educational change agent, educational revolution. 

However, the terms invention and delivery of new and improved educational 
technology seem to be somewhat more precise.) And although the school of 
education may have other outputs and concerns, for the purposes of this 
analysis, it will be viewed as a basic research and development unit. 

Looking at the chart generalizing the METEP Model - two organiza- 
tions - one sees the organizational administrative METEP Model applied 
to a local school system. Since the subsystems of this model have al- 
ready been explained, they will not be reviewed here. What is of con- 
cern are those subsystems in the local school system that will be coupled 
with the school of education in terms of programming change. One should 
note that there are three entry subsystems at which point the local 
school system is linked to the school of education. The first would 
relate to program revision or the engineering unit; the second is the 
personnel or manpower unit; and the third is the evaluator unit. We 
might look at each of these subsystems as programming linking units. 

New educational programs can be packaged and delivered in two or three 
ways. One package would be in some form of media books, films, lectures 
or television* Another form in which new programs can be packaged is to 
transmit the new programs through students at the school of education. 
These students will be hired and placed *n the local school systems and 
will utilize the new material. The thrid way is to take the existing 
personnel and imprint the new programs in the form of in-service training. 

Returning to our chart; in the subsystems program revision, one 
assumes the existence of a program design capability in the lo^cl 
school system or an engineering function. This function, on the 
basis of client analysis, can take the existing educational techniques 
and combine them into an acceptable and effective program in terms of 
unique client demands and unique constraints of the particular local 
school system. Rather, the local engineering group would have an 
array of educational techniques on the shelf, as it were, and given 
particular demands they would have the design capability of selecting 
and utilizing the correct shelf items. To use a rough analogy, we 
might view the local school systems as a special machine job shop 
with an array of various tools. When a customer submits a particular 
order, the engineer in the shop can draw up a blueprint which utilizes 
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the various machine tools available to produce that the customer 
desires. This engineer, however, is not inventing now tools. Because 
different local school systems have different: clients and client 
needs, that is, one school may be in a ghetto, while another school 
may be in a very high income suburb, local engineering units will 
require a different program mix to produce the desired output. 
Irrespective of the different environmental conditions of local 
school systems, what is postulated here is that schools of education 
as basic R and D units are continuously producing educational 
Innovations that are flowing to local school systems. What is of 
significance in delivery terms is that the school of education lias 
a promotion unit that is in the field explaining its latest new 
programming approaches, and presumably, this unit constitutes a kind 
of output or delivery unit for the school of education. This field 
group would be explaining or promoting the new technology to the 
local ''engineer 11 which is the program input unit of the local 
school system, In this way the two systems become coupled. Tims, 
the METEP Model assumes a field staff or marketing staff which on 
che basis of its current successful research, would be going from 
local school system to local school system selling or demonstrating 
such new techniques as differentiated staffing, instructional altern- 
atives, use of performance criteria, various media, et cetera. 

Assuming that the local engineering unit found these techniques to be 
productive, and redesigned programs along these lines and processed 
these programs through the local system, a demand would be generated 
for either new manpower or the retraining of existing manpower in 
terms of new technology. 

This brings us to the personnel subsystem. At this point, once 
again the school of education may become involved in terms of convert- 
ing the innnovations Into human behavior through, its own educational 
programs . 

The last subsystem to become involved with the school of education 
would be the evaluator. One assumes here the existence of a subsystem, 
which in terms of the rest of the system, can generate educational 
problems which the METEP field staff would pick up and redirect back 
to the school of education. The school of education, in trun, would 
invent new programs to meet the needs of the local school system. A 
technological gap would exist. Present shelf items would be Inadequate. 
An obvious case might be ghetto schools where the existing educational 
technology Is clearly inadequate in terms of what these schools would 
like to accomplish. Assuming such R and D could be funded and given 
the creative impulse of the school of adacation, a new program would be 
developed in terms of local school system needs which would be promoted 
or channeled through the marketing and promotion field staff back into 
the local school system at the program revision point, 
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Thus, we have a closed, improving programming system betv/een local 
school systems and the school of education using the M17ITP Model as 
the basic device to couple these two systems. The above view has been 
aporoached largely in terms of the point of view of the user of the 
programs, the local school system, rather than the producer of the pro- 
grams, the school of education* which has been the essential thrust in 
other parts of this report. A rationale for the MKTEP Programming Model 
Is included in the Appendix. 
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Summary - Implementation of Emerging Organizational 
Functions And Management System 



The purpose of organization is to execute plans. Thus far* a 
year and half has been devoted to program planning of METKP. Phase 
HI will continue program development while at the same time develop** 
ing an organization to execute those plans. Currently there exists a 
MKT UP Project Management which has been directing the Phase II opera** 
tions, If one looks at Figure 11 the present organizational form can 
be seen. There is a Project Director* Assistant Project Director in 
a staff position and a series of planning groups reporting directly to 
the Project Director. 

Within a year the organization seen in Figure 13 will be develop- 
ed to execute Phase Ill's development. This constitutes an interim 
organization and natural development from the present organization. 

The Project Director will continue as Director of the MET UP Program 
and two Associate directors will be added, Associate Director of Edu- 
cation and the Associate Director of Administration. Each of these 
directors will be responsible for a series of functions; all deline- 
ated on the chart and discussed in other parts of this report. Some 
personnel currently exists to execute, sec Figure 12, while others 
will have to he hired to perform these new functions. By the end of 
the second year of Phase III full functions will have beer, developed 
and METCP will be in final organizational iorm (see Figure 13). It 
should he noted that all functions will be consolidated under five 
directors. This will require three more directors than existed in 
the interim organization . The present Associate Director of Admini- 
stration will probably become Director of Finance. A Director of 
Program Delivery and Program Services will have to be appointed. An 
Associate Director of Research and Development will be appointed. 

The Associate Director of Education in the Interim Plan v:ill become 
Director of Education. These directorshi ps are assumed to be full 
time administrative positions. It is further assumed the work load 
ini 1) Program Delivery, 2) Finance, 3) Research and Development 
and 4) Director of Program Services will be sufficient to warrant such 
administration. If not, some of these functions nay be consolidated, 
so that one individual may perform more than one function. Each 
director shall determine how much supervisory assistance shall be re- 
quired within his respective functions. The present budget proposal 
provides for the foregoing organizational and administrative develop- 
ments . 

The steps necessary for the implementation of the management sub- 
system are outlined in Figure 14. Interactions with other system com- 
ponents are implicit. The management subsystem is described as an 
emerging process. Therefore, although feedback loops and cycles are 
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not explicitly illustrated, the evaluation and revision activities 
indicate the cyclic nature of the network. Activities associated 
with program dissemination and diffusion and client acceptability 
are included as elements of the management subsystem. 

Activities associated with the implementation of the other MliTEP 
subsystems arc outlined in subsequent sections. However, the simila- 
rity of pedagogical implementation steps docs not require a network 
activity chart for each of the educational programs. Therefore, the 
activities associated with the implementation of pedagogical pro- 
grams are outlined in Figure 15. The evaluation of instructional pro- 
cesses and materials will result in these programs being continuously 
refined. Hence, many of the activities listed should be considered 
as iterative processes. 
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Rationale for Model Elementary Teacher Education Program 
Programming Model 



The following is a brief statement relating to the historical 
reasons that led to a need for the MBTBP Model. This section will 
illustrate that the Model is capable of generality not only to schools 
of education but to other educational systems at the local level. One 
of the requirements of the research project is to explore the extent 
to which it can be applied to other educational systems. 

There are two general approaches with regard to the purchase of 
services. Services can be purchased on an individual and private 
basis or on a collective and public basis. On an individual and pri- 
vate basis, one has a buyer-seller relationship, wherein, if the two 
parties can reach a mutual agreement as to what should be delivered 
and what price should be asked, one can assume that one has achieved 
a measure of bo^h buyer and seller satisfaction. This is essentially 
a free market situation. A collective purchase is made through some 
form of political mechanism and it is this form that we shall look at 
in detail. 

The manner in which educational services v;ere to be purchased 
collectively either through local boards of education for elementary 
and secondary education or through state legislators for higher edu- 
cation emerged during the nineteenth century. The political mechanism 
was divided into three functions, the Legislative, Administrative and 
Judiciary. The following constitutes an ideal model of the functions 
the Legislature was to execute. It may, in fact, not have ever worked 
this way, but at least this is how we believed it was supposed to op- 
erate. 

One function that the legislative wing was expected to execute, 
was to analyze client, taxpayer or voter educational demands. It was 
assumed that the boards of education or state legislators would know 
what educational programs voters wanted. And presumably this know- 
ledge would be of a detailed nature. Boards of education would know 
If parents wanted Greek taught in schools and how much Greek would be 
taught. Boards would also know how much voters were willing to pay 
for such programs. The Legislature was also to perform an engineering 
function insofar as it would plan detailed educational programs. 
Presumably it would consider text books and educational packages as to 
content and various pedagogical approaches to be utilized. 

Another function the legislators were to perform was that of 
finance. They would draw up an educational budget and establish a tax 
rate to pay for the program and how much It would cost. Boards of 
education and state legislatures would also carry out the consensus 
function when client demands were in conflict. Finally, the boards 
or state legislatures would authorize the program in terms of legis- 
lation or appropriations. 

Educational programs were then sent to the administrative side of 
government for the implementation and execution of programs developed 
by the legislative branch. As for implementation, the administration 
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would have to purchase the necessary materials, hire personnel and 
provide the space to carry out the educational program. In terms of 
operation or execution, the administration would then carry out or 
execute the program which the board of education has determined. 

Thus, if the board of education decided to use McGuffey’s reader the 
teacher, in turn, would presumably teach the students to read with 
this particular book. For the most part, the accounting function was 
restricted to assure that there was a proper expenditure of funds in 
terms of the prior budget drawn up by the board of education. 

The organization of the administrative segment, then, largely 
reflected the functions to be performed* Thus, in terms of local 
education under perhaps the superintendent or principal, one had two 
basic functions: that of implementation as to the purchase of re- 

sources, and the other, operation as to the execution of programs. 

In terms of execution, the educational organization was structured 
along academic or disciplinary lines. The superintendent or president 
of the university, in the mai\., was restricted by the legislature to 
carry out educational programs developed by the legislature within 
whatever constraints, financial or otherwise, they had decided upon. 
The assumption was that the board or state legislature would be in a 
position to perforin rather detailed education programming. And, in 
very small communities in which the voter personally knew members of 
the board of education and met with them cn a regular basis, there may 
have been reason to believe that this particular political mechanism 
worked on a reasonably affective basis* One of course has in mind 
her. a rural community wich a little red school house and perhaps an 
itinerant school teacher in very close communication with the voter* 
There were small numbers of children involved and local detailed dir- 
ection. 

In the twentieth century, as educational systems expanded in 
school population, and society became urbanized, legislators became 
increasingly divorced from the voter or their constituency. New York 
is, of course, an extreme example with one million children in the 
school system* Further, the nature of educational services became 
technically more complex. Obviously, as it became impossible for 
legislators either at the local or state level to perform the expected 
detailed functions, they increasingly turned to an emerging profession 
al group inside the administrative sector - the so-called professional 
educators. The same phenomenon, of course, occured with other public 
services such as national defense, police, health and welfare. Edu- 
cation, then, as a service was not unique. At the local or state 
level, this emerging professional group might be superintendent, staff 
or a state educational official, faculty, professional curriculum 
developers, teachers themselves, and so on. This professional group 
assumed the legislative function in that they postulated client 
demands, planned and developed educational programs, drew up budgets, 
formulated and executed standards of evaluation, in addition to con- 
tinuing their traditional function of implementing and executing edu- 
cational programs* To a significant extent they took over all legis- 
lative functions except that of raising taxes. In effect, the pro- 
fessional educator took over the management and operation of the educa 
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tional system* This was not a unique phenomenon in the twertieth cen- 
tury because both public and private services have been taken over by 
professionalism. Thus, the professional soldier determines defense 
needs and manages the defense establishment, the professional police- 
man runs the police, the professional social worker operates welfare 
and the professional manager administers the corporation. 

The essential thrust of the professional, in a highly inter- 
dependent society is that the system with which he is concerned is 
technologically complex and that only he has the unique knowledge for 
its operation. This is true of the professional educator, physician, 
lawyer, minister, policeman and general, and the client should rely 
on the professional because he knows best. 

The professionalization of education seemed to work reasonably 
well and with PTA groups essentially organized as a public relations 
device, non-professionals, such as tax payers or students seemed will- 
ing to accept any direction in which the professional want to go. 

Aside from occasional client revolts in the form of objecting to cer- 
tain books or materials presented in the schools, it appeared to be a 
fairly acceptable and stable system. These objections by voters were 
usually viewed by the professional as the work of cranks, radicals or 
obstructionists ♦ 

As we have seen, however, the basic fault of a professionally 
directed educational system is as with any other professionally di- 
rected system, it became increasingly professionally oriented, or to 
a greater extent, it served professional interests. At the local 
level it began to serve teacher interests; at the higher level it in- 
creasingly served academic interests; until at both the local and 
higher levels this eventually led to a client revolt. 

The METE? Model represents an attempt to reintroduce an effective 
legislative function. It is obvious that one cannot reasonably ex- 
pect either the board of education or the state legislature to imple- 
ment the detailed programming functions which were assumed in the 
nineteenth century model: that of client analysis, engineering, 

finance, evaluation and promotion. A logical approach which the 
METEP solution is suggesting is that these functions should be es- 
tablished and executed within the administrative body (superintendent, 
etc.) but ultimately managed by the legislative body (board of edu- 
cation). For example, in a large educational system, it would be hard 
to imagine that a member of the board of education could personally 
perform a detailed client analysis; yet it would not be unreasonable 
to assume that he could administratively manage a function that would 
carry out such duties* Or in like manner, he could assure that the 
financial management was managed properly. 

If we are to solve the problems of the effective delivery of pub- 
lic services, a certain measure of organizational ingenuity will have 
to be exhibited. Unfortunately what appears to be happening is the 
assumption that the legislative function can he made client-responsive 
by either electing or attaching more clients to the present political 
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structure* A fundamental dilemma is that the traditional political 
structure has failed* The consequences of adding client representa- 
tives or undergraduates elect representatives or putting citizens on 
hospital boards would basically appear to be a futile undertaking. 

It is much like assuming that if the telephone service in New York 
City is ineffective , that this situation can be corrected by having 
the Mayor appoint two citizen? to Bell Telephone's Board of Directors. 
Given a large complex bureaucratic operation, it is impossible to see 
what effect two citizens would have on Bell Telephone* 



SECTION III PART II MANAGEMENT INFORMATION SYSTEM 
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MANAGEMENT INFORMATION SYSTEM 



In this part of Section III we discuss a feasible management 
information system designed both to control the progress of students 
through the Mli'lF.P structure and also to generate subsidiary management 
statistics for program liagnosis and analysis. 

The material to follow is divided into, four divisions. 

Division One provides a preliminary description of general infor- 
mation system design principles to motivate later introduction of 
operating constraints which we believe necessary for the success of 
this project at the present time. 

Division Two reduces these general principles to application for 
the case at hand. 

Division Three describes a basic information system proposed as 
a bench mark for this project. 

And, Division Four provides possible extensions and variations 
from the bench mark case to illustrate alternate cost/bcnefit choices. 

The reader with previous knowledge of information system design 
may safely skip to Division Three. Readers who wish to review the 
principles and application of information system design tu the present 
case should start from Division One. 
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Division One 



To understand the motivation as well as the necessity for tire 
information design choices proposed hereafter, it is necessary to 
appreciate several logical points, as well as the argument sequence 
described in this division. The theory expounded here is relatively 
simple: any information system can be evaluated on a number of di- 

mensions; most of them involve conflicting choice trade offs; and, 
to reach a final set of design specifications, some compromise must 
be made in the mix of desired ideal extremes. 



Five I mportant Information System S peci ficatio ns. Five system para- 
meters, or specifications, set both the cost and the performance capa- 
bilities of an information system: 

1. Inp ut /Ou tput Volume: Usually measured by the number of in- 

put transactions and output reports requii'ed during a given time 
period. Detailed analysis includes the number of lines, or the num- 
ber of characters of input/output volume. 

2. Response Time: Usually refers to the elapsed time between 

the request for information and its return to the requester. The 
response time of an information system must be related to any control 
or decision-making activities the system services. Very fast response 
times, e.g. a few seconds versus a week, usually require special 
system configurations and correspondingly increased cost when com- 
pared to slow response systems. 

3. Mode of Input/ou tput: 1 he choice of one or another form of 

human communication with the information system alters the equipment 
configuration, system programming, and user effectiveness as well as 
cost . 



4. Hum an Use Con str aints : In most information systems used for 

management purposes, human capabilities and use characteristics often 
limit processing performance due to input errors, limits on output 
volume and variety, etc. User capability assumptions thus become part 
of the total system specification. 

5, Hie Variety of In formation Proces sed : The variety of trans- 

action types, the variety of stored file content, and the variety of 
analytic and extraction classifications required determine the internal 
structure of programs, memory media that must be used, the type of 
reports that can bo generated, the flexibility of the system, and the 
generality of its application. Two important measures of system variety 
are the number of distinct transaction types that must be processed and 
the number of distinct sub-classifications by which a file record must 
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be identified. Similarly, the variety of system interactions (which 
determine system complexity) increases with t lie number of different 
file structures that must be maintained as well as with the number of 
cross-reference, sequential access, and status maintenance steps that 
must be performed to keep the system up to date. 

Of the five specifications, the last is the most critical, since 
it will affect, or be affected by, the former four. Thus , input/output 
volume by itself presents few design problems. If you must write 10,000 
identical payroll checks each week, you look for a simple; system that 
will produce that number of checks at the least total cost. But, if the 
payroll operation must handle a variety of different cases, c.g., con- 
struction workers who may in one day be employed at different skill 
levels, at different site locations, at different wage rates, the same 
10,000 paychecks rind the associated cost analysis requires a processing 
system of considerably greater complexity than before. 

Indeed, it is important to realize that the five specifications 
cited above become a related package when wc talk about information 
processing systems of any genuine interest for management control, as 
indicated by the two hypothetical payroll cases, for, if an information 
system is to be of general use for the management of a total operation, 
that information system must be able to handle a variety of conditions, 
produce a variety of reports as needed, and service a variety of manage- 
ment needs. 



Tli c Need to Comp romi se. Moreover, in any final design selection, the 
specification of the* five s/stem parameters requires us to compromise. 

The designer has monetary, technical, and human resource constraints 
that rule out many theoretically conceivable information systems as in- 
feasible. 

Within the possibilities that remain, he must now adjust the in- 
formation system parameters to produce the most effective information 
system to serve the specified management objectives, of which we shall 
speak later. In any case, given specified overall constraints and 
system objectives, the designer may trade one system specification for 
one or more of the others, c.g., response time for transaction variety, 
to achieve his final result. 

The important point is that the information system designer and 
his clients cannot have their cake and eat it, too. 

In any real setting there is always scarcity. If funds, technical 
skill, or human capability do not constrain, ultimately time itself is 
the avenger. 
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A man may search for the ideal wife, lie may be consistent, 
logical, and clear in his female specifications. But if his specifi- 
cations arc more than a few, and if they are related, his search may 
not succeed before his time has passed. If the searcher has conflicting, 
unstable, or unrealistic values, he is in further trouble. And even 
while he searches and evaluates his prospects, they themselves (or he) 
may change with the passing days. 

To get results, most reasonable men learn to compromise, lie who 
values blondes and also warmth may trade some of both to gain a spouse. 

To gain a problem's solution while the solution still has value, we may 
accept less precision, tolerate less quantification, and work with sketchy 
assumptions. We may also shift our values to get a feasible result. 

Practical decision-makers, of course, know the moral of this argu- 
ment: How you arc willing to compromise (as well as how much) deter- 

mines what you get. 

The misery of it is that, there is no good theory of how to compro- 
mise in specific, complex cases, nor bow to compromise in time. At the 
moment of truth, you are on your own. 

However gloomy it may seem, something-- if not all--can be gained 
from experience; a pattern of planning and selection can bo developed, 
even a theory. (If we cannot so plan, if the world offered no patterns 
to learn, education itself would be worthless.) 



Classi cal Co st/Benefit De cisi on Methods. When selecting the final 
information system design values, you can proceed as follows: 

A. State a level of constraints: monetary, technical, and human. 

B. Formulate the objective of the system in terms compatible with 
the system parameters previously discussed. For example, how much does 
faster response tire contribute to the information objective? How much 
does file variety contribute? In practice it is difficult to come up 
with specific numbers, and the effects are usually non-linear and non- 
additive as they contribute to the whole. But, for the moment, assume 
we have the easily combined effectiveness measures. Then, just as we 
compute the score for a football game by accumulating seven points for 
each touchdown, three points for each field goal, etc., we may compute 
an objective value for each proposed feasible system. 

C. Select the system design parameters th-t maximize the objective, 
given the stated constraints; or conversely, given a fixed level of per- 
formance to he achieved, adjust the system parameters to achieve that 
performance level at the least use of resources. The results are identi- 
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ca] in both approaches given common performance, or objective levels, 
a fact noted clearly elsewhere. 1 

D. Repeat t lie process for different constraint assumptions (or 
conversely different performance requirements as above). Make the 
final selection on the basis of the information system which has the 
host cost to performance relationship for the scale of enterprise at 
hand. 



This is the now classical cost/bcncfit theory of selection. 

Usually it must be modified somewhat in practice, largely because the 
performance criteria measures are difficult to define, quantify, and 
combine. But, the procedure 1 s hope is that, the compromises made in 
system selection and design can be delineated and approached rationally, 
rather than otherwise. That philosophy is worth using-even if you 
must take some shortcuts to make it work. 



Practical Compromise Techniques. Several practical approaches can be 
used to modify the above theoretical selection approach so that its 
spirit may be applied in the absence of detailed objective quantifi- 
cation. for example, both users of information systems and system 
designers may be able to agree upon given system parameters as con- 
straints or requirements rather than objective measures, which must 
be sealed. To illustrate, we might agree that :• given information 
system to bo of any use to us must handle at least 100C transactions 
of at least five distinct types per week. 



’Ibis approach eliminates a non-quanti fiable and possibly incom- 
mensurate objective measure by its conversion into a requirement, liras, 
as a first practical approach to overall system specification we 
exploit the use of system constraints and requirements. 

A second important practical point is that information system 
design choices d.:. not offer a continuous range of opportunities, ho. 
example, we may need to consider only several major alternatives, siu«<' 
intermediate choices are not available. If a computing machine must 
be selected, we have a limited choice of perhaps half a dozen levels 
of capacity to consider, not an infinite number. 

Similarly, comparisons of one benefit level to another nay be 
considered in jumps. Nobody (except in rare instances and certainly 
not here) cares about benefit improvements of one percent— even at 
fixed cost. Ke look for ordor-of-raagnitude improvements in cost/ 



Hi. Hitch and R. McKean, The economics of Defense in a Nuclear Age, 
Harvard University Press, Cambridge. 1%>; Athenerim, NeK~YorkjT 1P67 
(paper). 
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benefit results when comparing alternatives. If such major differences 
can be found, many of the measurement problems inherent in close com- 
parisons vanish. 

So, if v:c constrain and eliminate, we thereby simplify: the range 

of choice is quickly limited and the choice evaluation becomes tractable. 

To continue this approach (which wc advocate with enthusiasm), wo 
can now invoke several oilier principles. Both of the following points 
constrain system variety. 

In a given information system some transactions, inquiries, and 
reports will bo much more frequent than others, ('lire same principle 
holds true even though the events under consideration may be weighted 
by their presupposed importance or value for management purposes.) To 
illustrate, wc know empirically that if a firm has 1,000 customers, it 
is not unlike!)’ that ISO of them will provide 80 percent or more of 
total gross sales. Many of the customers on the list are of little 
consequence in the total picture. In designing a control or informa- 
tion system, the less frequent (or less valuable) volume of variety 
usually may be treated less seriously, or even eliminated from con- 
sideration, without a definitive percentage loss in total system 
performance. (An alternative to elimination of detail is its grouping 
for class treatment ; the simplification that results is equally help- 
ful in the resolution of system specifications.) 

Similarly, it is an empirical fact that some forms of detail arc 
of transient interest, although other forms are of permanent value. 

To distinguish between t lie two is to simplify again. There may be 
important special cases as time goes by, but no information system 
designer a: ! few management users arc smrt enough to forecast them 
ail. Moreover, no reasonable information system can be planned to 
hold all t he information that could possibly be of interest to every- 
one in an organisation over an extended time. By building variety 
and volume from those items t’.at arc required over tine, those which 
are likely to be of lasting importance (and those that our best fore- 
casts indicate will be of major later importance) we can adjust the 
variety of the information system to include those important items. 

The remainder of our processing may then he forgotten, grouped, or 
handled as special cases if they justify such treatment. 

The list of practical compromise techniques nay be extended, but 
vc have cited enough to n.ako t he necessary point: it is possible to 

find helpful techniques that can convert .an otherwise hopeless system 
selection problem into a decision of maximum efficiency. 

Ilow these short cut strategics are employed, remember, determines 
the final information system that will be chosen. Yet, in the absence 
of these compromise techniques for others like them) the theory of 
cost/benefit choice, though challenging, is sterile. 




391 



1 low you compromise determines what you set; but without soi:iO 
compromise, no practical result will come to pass. 
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Division Two 



The previous section was necessary to set the stage for the tie- 
tailed compromises required to make the MliTliP information system work. 
We continue the previous argument, but now direct it to the case at 
hand. 



MliTliP and Tolerable Syste m Va riety. From an information system de- 
signer's angle, Che first striking characteristic of the MliTliP educa- 
tional proposal is that its information needs demand greater informa- 
tion variety and handling volume than do current educational processing 
systems . 

For example, one educational principle in the MliTliP proposal is 
that students have a vaiiety of instructional alternatives (lA's) 
available to them for each step in a chain of ins iruct i onal progress. 
The increments in progress, which consist of passing specified per- 
formance criteria (PC's), form an increasing student history. At 
some designated level of total competence, achieved by the completion 
of a given number of PC's (many of which arc elective), the student 
graduates. In this progression no time limit is imposed and PC may 
be demonstrated by severe 1 means, .including pretests which can obviate 
1A pnrticipai ion. 

Without discussing the merit? of this principled-designed to give 
the student more flexibility, involvement, more rapid progress, etc.-- 
consider how an adjustment of the number of distinct lA's and PC's 
available for choice affects an associated information system and its 
users . 

As a starting point, assume that all PC's arc independent and 
can be selected at will, in any sequence, like items from a Scars, 
Roebuck catalogue. Further, suppose that any IA associated with a 
given PC may also be selected freely by the student. In this ease 
each student could generate a possibly unique historical record 
which for counseling, testing, resource manning purposes must be 
cross-referenced with other files and summarized from time to time 
to provide management statistics on the student population. 

Now consider the following extreme proposals for illustration. 

Case A; Only one PC. Suppose only one PC were required for 
graduation, c.g. , one lengthy periodically administevd final exam- 
ination. Suppose further that there were no choice cf lA's; every 
student was subjected to the same treatment, at the same time, and 
in the same sequence. This situation is the in format ion system 
designer's delight, because few if any records need be maintained 
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and resource! planning is trivial. The MliTlil* proposal, however, seeks 
to alter the possible consequences of such a scheme: total inflexibi- 

lity of student choice, a fixed time in the program (and its sequential 
partsj for all students, and the requirement that all students progress 
at the some pace in all subjects, which we know empirically is not 
possible. Thus , even though the information system designer and 
facility planner would like this traditional extreme, it clearly has 
its educational drawbacks and the Mil'll;!* educational proposal is to 
discard its extreme constraints . 2 

Case b: A H o st o f PC's . At the other extreme, suppose we now 

propose 25,000 PC's and associated lA's. To toko a number for illus- 
tration, suppose a student must complete 1,000 PC's to "graduate". 

Since the number of ways 1,000 items can be picked from a list of 
25,000 is more than astronomical, the information system needed to 
control such an operation, particularly its cross-reference and plan- 
ning requirements , is of necessity a complex and expensive operation. 
Here arc two consequences of this case, 

1. ) If the student (or his counselor) must make the 1, 000-itcm 
choice, both must understand and know the content of the catalogue. 

This situation may be compared to the diner who approaches his waiter 
in a Chinese restaurant requesting information on what to cat, The 
waiter, who may have an extensive printed menu before him, usually 
has no idea of what all the item? r-rc--nnd knows the diner doer- not 
either. The waiter simplifies at once and suggests egg lolls ami 
fried rice. If the diner should ho bold enough to request an exotic 
dish, the cook may not know how to prepare it, or net have the neces- 
sary ingredients to do so. Empirically, humans have little tolerance 
for excessive variety and quickly simplify on their own; and, more- 
over, it is not feasible to have large reserve capacity in little 
used resources. 

2. ) As the number of PC's increases, the elapsed tine foi their 
completion necessarily decreases, lor example, for the 1,000 PC com- 
pletion criterion and an assumed four year duration for the student's 
schooling, more than one PC must be completed each day of each academic 



^This extreme is typical of many European university practices, in 
which the student and his tutor periodically confer, and in which the 
student is free to prepare himself for the ultimate examination as he 
sees fit. In this regard, even this one PC approach offers the student 
educational flexibility, but success by this route presupposes self 
motivation and student intelligence above average, as well as quality 
tutors. Without such an elite, the method fails, and we choose not to 
make the elite supposition here. 
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ycai* to achieve graduation within the four-year period. If detailed 
PC records and associated JA choice records are maintained, not to 
mention testing and counseling, the time consumed in record-keeping 
and choice of activities becomes a large part of the student and 
staff day. The transaction volume against the information system 
explodes and the response time for counseling, resource planning, and 
student, choice decision must drop to real time, '/he result is an ex- 
ponential increase in information processing and staff cos v , as well 
as a reduction in the student's effective use of time. In short, with 
excessive variety and volume of choice, the very purpose of MLTliP educa- 
tional proposals is defeated, Ke can predict what will happen here 
too. Both students and staff will seek their own simplification pro- 
cedures usually by grouping large t'C blocks. Systems with excessive 
variety beyond the capacity of their users to handle it fail unless 
they are < ut to size. 



The 1 lliTli I* Proposal Vs. Industrial lixanples, It is easy to argue that 
the extreme case (fi) is technically feasible by citing existing infor- 
mation processing systems which handle even greater variety than the 
hypothetical case, for example, department stores like Macy's steel; 
500,000 items; some military warehouses stock over 2 million; and, the 
Internal Revenue Service keeps computer records on approximately SO 
mi 11 loti individual t a < accounts. What is done can he done. And, in- 
deed. the information processing required to liundJo Case It, above, 
feasible — if we set aside human and monetary constraints. 

However, t ire differences between the cited large scale information 
systems and the extreme Case B arc several. 

1. ) On -go i ng , largo scale information systems usually work on a 
large economic base per transaction, or file record, liven though an 
airline reservation may cost $l-$2 to initiate and maintain, that cost 
is directly offset by the- ticket purchase. Kith detailed 1'C and asso- 
ciated IA record keeping, up to four transactions per PC might be ex- 
pected. lor the 1,000 PC student quota assumed in Case 1>, the cost of 
a transaction is comparable to the. airline system (on a real-time 
basis including human input/output time). A $1,000 annual per student 
cost for keeping records, particularly if such records do not add to 
the student’s effectiveness but detract from it, is not appealing. 
Moreover, we have no direct way to evaluate the benefit to the student 
or the system of an additional transaction so the case of marginal 
economic decision-making that obtains for, say, order processing 
systems, is not present here. 

2. ) Most large scale information systems users need not under* 
stand the total scope of distinctions contained in the total inforna- 
tion system. The typical large scale system works in independent 
groupings of detail, which come together only in summary. 
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When this fact holds, efforts may he highly departmental i;:ed, 
hierarchies of organi zat ion imposed, ami system variety for individual 
human effort and information processing thereby constrained. 

To illustrate, the furniture buyer at Maev's nerd not know in 
any detail what the cosir. dies buyer is vy» to, nor do the chief execu- 
tives of that firm need or want to know the Absolute detail of each 
transaction in any department. The managers look at summarized finan- 
cial statistics, o: spot check exceptional reports. Indeed, they 
could mot handle the excessive variety of the total detailed picture. 
The same argument applies to the firm's customers* 

Yet, if wc take seriously a Ingh component, of DC and 1 A variety 
in the MJi'lliP structure, and offer that total mom to students, coun- 
selors, and administrators to coordinate as an interrelated whole, wc 
presuppose that both managers and customers will be able to got the 
totv:l choice picture in wind so they can not only find routes through 
the. marc but also find individually satisfying and effective paths to 
the' completion of their respective tasks. 

ihc nearest industrial analogue to the MUTKO proposal is the job 
shop which undertakes manufacture of many distinct products, usual!) 
in very short production runs, on many different machines. Because 
the machines arc jnterrclat cd by the routing rcqtii i cncnls of each 
iter., such facilities are usually plagued with planning, sequencing, 
cost, control, and coordination problems substantially more severe 
than the limited variety operation. Work in process grows due to 
machine interference and product queueing, or altcrnat i vclv substantial 
excess capacity must be provided to buffer the independent operations, 
hither alternative adds to the cost of system variety. Yet another 
"buffering" that rakes such systems of manufacture work is increased 
information handling, c.g., expediting, real-time rescheduling, etc., 
which is just an alternative cost-substitution for excess inventory 
or Machine capacity. 

In short, variety which cannot be simplified is an additional 
source of cost, and even job shops have begun to group and simplify 
their operations by grouping and creating independent sub-departments 
by product families.' 1 



^Business K eek , "A Kay to Make Diversity Pay Off", October 18, 11*69, 
pp* 162-154. Ibis article describes job shop planning in I-urcpc and 
Russia using a "family 1 ' grouping concept of machine location and load- 
ing. Two articles, M. Tondow, "Computers In 1 lie Schools: Palo Alto", 

IkUanalJon , June, IPOS, pp. 57-62, and A. (irossran, "Hie California 
liduc.Mional Information System", iMVnmat ion, March, 11K?9, pp. 32-37 
illustrates school applications that al first glance appear similar to 
the present ease. However, although large numbers of students are in- 
volved in each reported application, the record keeping is for highly 
independent records end files, quite contrary to the job shop type ap- 
plication present cd bv the Mill:** proposal. Ihc two forms of processing 
should not be confused. 
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Another alternative in the machine shoo analogue is the use of 
general purpose machine tools, often with numerical computer control 
or semi -universal jigs and fixtures to promote flexibility. In the 
educational scene this approach supposes one teacher can handle a wide 
variety of subjects and students as effectively as a specialist in eacli 
cf many areas. Wo must also suppose that the teacher may be scheduled 
to do so according to the immediate demands of the work load. There 
may be a few teachers who are both capable and willing to accept such 
a challenging assignment and attendant uncertainty, but surely such 
flexible requirements would limit the pool from which teaching candi- 
dates can be drawn. 

3.) What is done can be done. It may bo argued (setting economic 
arguments aside momentarily) that such information handling efforts as 
the control of lunar landings and automated chemical plants which sur- 
mount great apparent complexity, could equally well handle the desired 
variety in an educational setting. This route to success demands the 
relaxation, elimination., or replacement of human constraints. Ihus, 
if we could eliminate the teacher through the use of computer assisted 
instruction, a multitude of I’C's and I.Vs night present no administrative 
problem. The route to graduation, the diagnostics, the record-keeping, 
the counseling, the teaching and the testing could be reduced to computer 
terminal input/output interaction with the student. The teachers could 
devote themselves to creating teaching programs that would have great 
multiplicative benefits. And. it is possible that the cost per "pro- 
cessed” student would be less titan at present if the approach were 
extended to a sufficient base, or student population. 

Such proposals have been made for some time, and as the cost per 
student terminal hour drops to $1 or less (excluding course preparation) 
this route to variety conjures up a cornucopia of dreams --many of which 
will become a reality. (In some applications t lie cost per terminal 
hour is already less than $1 per hour, a fraction of the instructor's 
hourly cost per student in a typical class. 1 Kc can have immediate 
student diagnosis for dot ail* -Spell ing, grammar, mathematical rules, 
language translation, scientific computation, simulated experience, 
etc. The technology will not fail us, and the economics can be made 
realistic if we arc willing to eliminate also excessive human inter- 
vention on the teacher's par* in the educational process. Tliat is 
the compromise required in this last illustrative alternative. 

Vet, if the educational system omits the direct human interaction 
required to achieve the latter form of success, it thereby relinquishes 
also the variety of cultural values that society transmits to its 
young through their association with other individual human beings, 
fven setting aside the problems of creating computer programs that 
could evaluate the quality and importance of a stuJent's written theme 
or screen his other forms of creative cliort, it should be clear tliat 
an automated system rust standardize its "voredures of selecting ex- 
cellence in non -logic.**' , non-quant ifi able areas where human judgement, 




397 



intuition, compass i on, and redemptive sense can admit and will accept 
a variety of evaluations, as well as pass that ability along. In short, 
although the superficial promise of automated teaching and administrative 
systems is the promotion of greater variety of student choice and exper- 
ience, it may well turn out that such variety is an illusion. We tnuy 
end up producing virtuosos who expertly generate variations on a theme; 
but the constant theme itself will be set by the computer program that 
evaluates linglish 1, or its equivalent. 

The haw of Excessive Variety is with us still; in the latter case 
it just manifests itself in a more insidious and disguised form than 
before . 

So even though it is possible to handle large-scale systems with 
success, we must compromise to do so. We pay more (one way or another) 
for increased variety and increased flexibility. That must he a fore- 
gone conclusion. Wc also never get around the need to make a compromise 
with the ultimate variety that can occur in any selection process that 
offers any range of alternatives. That necessity, too, is a foregone 
conclusion. 

How shall be compromise, and how much shall we pay for variety, 
in the present case at hand— the Ml.Thl’ proposal— for increased flex- 
ibility in the educational process? 



Feasible Constraints f or M EThP Control. Without going further into 
dotai 1 Vt "slioul d \><T clear that the* authors of this Section are in favor 
of gross simplification in the degree of METHI* variety— at least at the 
outset and under 1970 economic and human constraints. Our industrial 
experience as well as information handling theory can lead us to no 
other conclusion. 

Although we are in sympathy with t lie aim of more flexible educa- 
tional experience and a reasonable variety of PC and associated IA 
choices— which nay offer the student more flexibility, satisfaction, 
and timely progress— we arc also of the opinion that an excessive 
range of choice would be detrimental, confusing, and frustrating for 
the student, as well as cumbersome, costly, and possibly chaotic for 
administrative planning and control. Kc have not been able to convince 
ourselves that there is a direct and infinitely continuing relationship 
between increased educational variety (with correspondingly increased 
costs) and ever-increasing diiect benefit to the student or to society. 

Within limited ranges of variability, then, wo do view the MMF.P 
proposal as beneficial and feasible. But it is within 1 ir.i ted variety 
constraints that the following information handling proposals are made. 
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A IJcjich Matk, To provide a feasible design we now suggest an infor- 

mation processing and control systen for Mli'IHP that will meet clearly 
feasible economic, technical, and human limits. IVc sketch the major 
assumptions lure, describe the detail in Division Three. Then, in 
Division l ; our we indicate the extensions and variations that can be 
made from our standard of comparison* 

Although our bench mark system is based upon our best exper- 
ience and theoretical knowledge, it too represents a comproni se— an 
arbitrary choice based upon what we know about information systems, 
the MliTHP program, and the limits set by both. Most standards, in 
fact, are arbitrary, though necessary. So is the following prototype 
design specification arbitrary: it is a feasi ble point from which to 

work. 



Some fe asi ble Assumption^. In the initial view of a proposed MI;TI;P 
sys tern/ our pedagogi cal colleagues indicated an interest in record- 
keeping for upwards of 20,000 PC's (and the corresponding number of 
1A variety). It was our initial opinion, for reasons heretofore 
delineated, that for human, cost and technical reality, such a diver- 
sity would not be feasible in the present setting. After numerous 
discussions, the total list of PC's and associated IA's was reduced, 
for thirteen pedagogical areas, to 717 PC's and 1521 lA's, as detailed 
in Table I. Such a list is clearly feasible from an in format? on 
cessing point of ciaw, a i;d b, .June iu, 1 OOP, we had accepted tnesc 
upper bounds for further study. ** 



^ I ). the computer simulation described elsewhere in this report the 
total number of PCs used was SSI, and the total number of associated 
lA's was 918. These numbers, somewhat lower than those shown in Table 1, 
were for "Generalists” only, and did not include any specialization. 
Further, the simulation runs reported required students to complete all 
981 PCs, except for those waived due to pre-tests. In this sense, the 
simulation foeusoJ on scheduling problems and student choices over time 
not to a student choice of given PCs I rom a larger list. The require- 
ment that all PCs in a given list be completed was a necessary assump- 
tion in the preliminary simulation designs. However, following the 
Ml -TCP philosophy, later choice patterns in practice will permit selec- 
tion from a larger PC list of which Table 1 is typical. 
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TABLU 1 



INITIAL SPECIFICATION'S FOR 
VAUMilY IOR A FLAS1BM; F.p.NCII. 


PC AND IA 
MARK DkSKiN 




„ , . 



Area PC 9 IA « 



Social Studies 


122 


297 


iiarly Childhood 


27 


60 


Language Arts 


78 


204 


Human Relations 


14S 


310 


Math 


76 


130 


Behavioral Arts 


91 


170 


Science 


17S 


350 


Total : 


717 


IS 21 



It was nevertheless our view, as discussed in Division Four, that 
further simplification and organization would ho necessary for human 
understanding of the system and particularly for the scheduling of 
resources. Although these initial simplification arguments were later 
found to be a valid necessity in practice, we nevertheless proceeded 
to develop a bench mark information system design that would handle 
the required variety of PC's and lA's, as stated in Table* 1 on a one 
week batch updating basis, for a volume of SCO students at approximately 
$100 per student annually (a cost which equals about 3* of total annual 
educational cost per student, and seemed to us feasible as a starting 
point). 5 No further presupposed that re ourcc scheduling would be on 



$The actual cost per student r* nest institutions ranges from $3,000- 
$■1,000 per year, when all costs, both operating and capital, ore con- 
sidered. lims, the $35 nil lion operating budget of the University of 
Massachusetts , when divided by 15,000 students, provides an operating 
cost per student of over $2,000. Amortized capital costs for buildings, 
cquipincnt, etc., when added to that sum easily bring t lie total figure 
into the $3,000-$ I ,000 range. In the financial section of this report, 
an annual $1,580 cost per effective student is cited for present School 
of Lducal ion operations, with a projection of $1,967 under the MLH P 
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a manual basis at this time, but that the bench mark system must provide 
both historical -uiu forecast assistance to resource planners, be they 
either a centralized or a departir.entaHr.ed group of personnel. Within 
the spccifi cations and assumptions outlined above, the information 
system of Division Three Is feasible and may be modified, as therein 
indicated, to shift with later alterations in system specifications 
without drastic revision of our proposal. 



^(continued) proposal. These latter figures include only the salary 
Costs of instruction and administration, plus some allowance for special 
laboratory facilities and equipment directly attributable to the School, 
and therefore exclude all additional operating costs, as well ns capital 
costs, Addition of the omitted costs brines both the overall figure 
used here and the specialized figure used Inter into agreement* finally, 
for the sake of comparison, the net instructional cost per student at 
l be University of Massachusetts, as reported in the A\UP bulletin, 

June, 1969, p, 231, is $S05 per student. Ibis figure nay bo rcconei led 
with those given above by the addition of nil costs not due to profes- 
sional instruction salaries, further comparisons made in this Section 
are based ujxm the §3,000- $-1 ,000 gross cost, first explained above. 



Division Three 



The current technical state of management information system art 
as well as current design methods have been reviewed elsewhere. 6 Briefly, 
major interest revolves about file structure and content, as well as how 
such files are tied together by processing procedures and input/output 
requirements. Although file accessing techniques are well developed 
not only in general but also fer specific applications* file structure 
in a given ease can be improved only when actual statistics of use have 
been obtained. Thus, most existing information systems of the type de- 
scribed hereafter, rely heavily on redesign of an initial test system 
once the facts arc in. 

For example, if certain transaction types, or certain file cate- 
gories in fact show higher than average activity rates, the identifi- 
cation codes and file structure for these selected items may be altered 
to increase processing efficiency. If some file categories are never 
or seldom used, they may be eliminated or grouped with others, to re- 
duce file complexity. Yet, to perform such refined improvements wo 
must know how the particular users of a given system will in fact use 
it , 



Thus, in addition to the provision of initial conlrol, one purpose 
of the proposed henrh mark system is to generate historical ums statis- 
tics that can lead to later redesign. Since we do not now have such 
figures, we have used our best estimates of what will be needed for 
the MliTHP bench mark design. 

File Types and Structure, The proposed system employs four files, 
sTrucFuTeT' TnTtiiUJy as in Table 2. (In that, tabic, the file content 
and format appear in the style of a COBOL language DATA DIVISION and 



&C. A. Cuadra (Ld.) Annual Review of Information Science and Technology, 
Vol. 4, Britannic?* Reviews, Chicago" (Uctolv^f llfotf) . This vb 1 ume~ spon- 
sored by the American Society for Information and the National Science 
Foundation covers progress through 1968, See especially Chapter 2, 

R. V. Katter, "Design and Evaluation of Information Systems 11 , and 
Chapter 4, M. 13. Scnko, "File Organization and Management Information 
Systems 

See also Datamation, November i960, "File Management Systems: A 

Current Suiimia Caro 1 y n J. Byrnes and Donald B. Stcig, pp. 138-142. 



is largely self-documenting, although we shall review the details 
momentarily. COBOL is a computer language widely used for file mani- 
pulation, and is in standard U. S. Government use for this purpose,) 

The four files are: (1) a student record file, (2) a resource 

record file, (3) a PC catalog, arid (d) an iA catalog. The latter two 
files are to be used as a unit; the separation is for technical proces- 
sing efficiency rather than for logical reasons. 

The student file contains a record for each student in the system. 
Each such record is divided into two parts; the first, a "header" con- 
taining complete student identify oat i on , test, profiles at entry, etc., 
the second part is the historical record (which may contain a different 
number of entries for each student, or for a given student as time 
progresses). The student history details the PC progress for that 
student, In the file description shown, we have first assumed that 
the PC history will not exceed PP9 items, but this may be extended as 
necessary. The PC record segment shows the PC chosen, the date started, 
and the date completed. One field has been provided for indicating: the 
IA chosen for a given PC, should that information be of permanent in- 
terest (by student). For example, we may wish to know later if students 
of a certain type consistently select, one IA for a given PC, The DATE- 
COMPLETED field wi 1 2 be used to record, in addition to actual PC com- 
pletions, oilier possible outcomes of the PC encounter (withdrawals, 
failures, substitui Lons, repetitions , etc.). Seo inter discussion 
of transaction types, 

ihe resource fHc contains a listing of all available resources 
that must b- planned for or scheduled, including human resources, 
physical sjvwv, and equipment. A historical portion of each resource 
record provides both for a recap i tula t j on of which resources were used 
at what time, and also for a precommitment of resources, before they 
arc consumed, for the purpose of capacity checks. For each resource, 
we also have "availability 11 figures, in terms of hours that may be 
coimnittcd per week. Through appropriate identification codes, the 
particular resource indicated may be - icd to a given individual, room, 
or piece of equipment. 

'Jlie PC file lists all PC's currently available to the educational 
system, with t he corresponding PC code, for later statistical analysis 
by area, by group of PC's within an area, etc., together with a variable 
length cross- reference list (which ties the VC, file to the IA file) to 
avoid repetition of I A detail in the master catalog. ‘Ibis is so, be- 
cause in some instances, one I A may satisfy one or more PC's as well 
as vice versa. 

'Jhc I A file contains a listing of all the lA’s currently available 
to the system. Each IA record contains the required resources that 
need be committed for its completion, as well as a historical record 
of that TAPs selection and use. Note that from a given PC record, we 
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TABLE 2 

FILE TYPES /Nf) STRUCTURE 



DATA DIVISION. 

F l Lb. SECTION. 

FU STUULNT-F 1 Lt ^cXORUlNu KOJt IS BINARY MYPlK UtNb I T Y • LAbtL 





AWc. 


STANdhPD VAtUc. OP 1 uLNT l F I U mT 1 UN I 




! ST UU LNT 


-K iLt© 


DAT A 


WtCORu IS STUULNT-F I LC-DmTA# 






Ol STUDENT' 


-F I LL-DATA. 








oz 


HEAuEH-WECOWU . 










03 


S T UDt NT - NUMBER 


PICTuWt 


I S 


9C 7 } • 




03 


l TUDE.NT-LAST-NAML 


PJCTuRt 


IS 


A(20) e 




03 


S T UULNT-K IWST-NAML 


P I CTURt 


I s 


A < O ) . 




03 


STuDcNT-StX 


PI CTUPt 


I 3 


y . 




03 


STUDENT ~LOC Al-ADDRcS S • 












04 bTATt 


PI LToKc 


i S 


M{ Z > • 






04 CITY 


PI CTuKc 


IS 


M ( JS). 






04 STPttT 


PI CTlRl. 


I s 


A { Z 0 > • 






04 ZIP-Cout 


P i Ll U^r. 


i s 


y < b ) • 




03 


STUUtNT -LuCAl-HHU*Vl 


P l C T UK t 


is 


y i ? ) • 




03 


S TUDLNT — MUMc.— AUJf<t.^b • 












04 STATE 


PICT Ukt 


1 s 


A ( Z ) • 






04 CITY 


P I CTUPL 


I s 


Ml lb > • 






04 STRLLT 


PI 0 7 0'K CL 


I s 


A < Z 0 ) * 






04 ZIP-CODt 


PI CTukL 


I s 


VCD)* 




03 


STUDENT -FIU^t-PHONt 


PI CTuRt 


1 s 


vi I 0 ) • 




03 


STuDtNT-MAjOR 


P l CTuRt 


I s 


y < c: ) . 




03 


STUD t NT — Suck -MAJOR 


P 1 C T U P t 


IS 


y ( ^ • 




03 


sT UJtNT -PK dF 1 LL uuuUKS cl^> 


T I i v ‘kL S . 










04 STUDCNT-PWuK I LL-KtcUHU 


PICT uK t 


IS 


y < u> • 




03 


STUUCNT-PclKF OKhAt\lt-UAT a 


PI CTuku 


i s 


y i j i • 



uZ STUUC.NT-PLKi'UKi'iMN^L-NLv.tKLy uLLUkS 1 Tu WV T I MLS 
Dt.Pt.NLJ I No ON STUDl-NT — PilKF UKhANU;- uAT A * 

0 J L/ATA“kt^v^U* 



POOR ORIGINAL COPY - BE£I 
AVAILABLE AT TIME FILMED 




I 



TABLE 2 (Continued) 



KU PC-FlLt Rt^COPdNo MCJUL lb dlNAKY HYPtP UhNbiTY. LAotL 
KtCOPUb AWfc. bT ANl> AKu VALvt. OF l UtNT 1 F 1 CaT 1 UN lb 
9PC-F iLt® UATA kLtuWu lb PC-uATA-F 111 . 

01 PC-UATA-F 1 Lt. 



u^ 


PC 


-CODE. 










03 


PC -"AREA 


PICTURE 


1 s 


9(2) 




03 


PC-SUb— AkEA 


PICTURE 


I s 


9(2) 




C3 


PC-SEKl ML 


PICT UkE 


i s 


9(2 ) 


02 


PC' 


-TYPE 


PICTURE 


1 s 


9, 


02 


PC 


— EVALUAT J ON-TYPE 


PICT uRE 


I b 


9. 


02 


i A 


“TRAILER 


PICTURE 


IS 


v » 


02 


PC 


~F lLE-1 A-TRAlLER OCCURS 1 


T O 10 T 1 Mtb 






DEPeNUINO UN lA-TKAlLLK. 










03 


PC-1 A-CCDhS 


PI CTcRt. 


I s 


9(3) 



FL> lA-FJLt RtCORUING tfOUc. IS UINAkY HYPLR OC-MblTYt LrtotL 
RtCOROb ARh STANUARU V*L\Jfc Or l UtNT I F 1 C AT 1 ON lb 
(?iA-FlLtS DATA Rt-CORU lb I A-UmTA-F 1 Le. . 

0 1 lA-DATA-FlLC. 



02 


PC — I A-COOh. * 










03 I A - ARc_ A 


picture 


I S 


9(2). 




03 I A-bUb— AREA 


picture 


lb 


9(2). 




03 IA-SERIAL 


p i cture 


lb 


9(2). 


02 


I A-COOE 


PI CTURE 


I s 


9. 


02 


I a-huuws-per-ween 


PICTURE 


is 


9(2) . 


02 


TOTAL- i A-T 1 WE 


Pi C TUKU 


i b 


9(2). 


02 


MI NIMUM-STUUENTo-ReGU 1 RED 


P I CTURE 


Is 


9(2). 


02 


MAX l MuM-STuUENT b-POSS IbLE 


PI C TORE 


I s 


9(3). 


02 


TYPE -OF - HU-* AN-'R- SOURCE 


Pi C T UkE 


i s 


9 ( J ) . 


02 


NO-OP -WEEKLY -CONTACT -HOURS 


PICTURE 


1 o 


9(2) . 


02 


OTHER-HUMAN-RI-.SOUrCE 


PI CTURE 


I b 


9(3). 


02 


PH YS I CAL-SPAcl-RLUU iKLU 


PICT uki_ 


I s 


9(2). 


02 


EOU i PMENT — REUO I RLU 


P I C TORE 


is 


9(2). 


02 


NAME 


Pi CTURE 


I s 


A ( I 2 ) 


02 


OFFtRlNUS OCCURS 2A TINeS. 










03 OFFER— T i M l 


Pi OTURE 


I s 


9. 



POOR ORIGINAL COPY- 
available AT TIME FI 




•BEST 



TABLE 2 (Continued) 



FD 



04 P-C. 





b 


P-C-AWhA 


PI OTOWt. 


I b 


M( h > 




b 


P-C-bUU-APL A 


PICT ukt 


i b 


A i h J 


04 


Ob 

U ATL 


P-l-bLK i AL 
-bTAkTcu. 


P I O T i ■' L 


l b 


A { £ > 




Ob 


bl AWT-YLAk 


PlcT.'PC 


I b 


V • 




Ob 


STAkT-f'iONTH 


PICT OKU 


I b 


V ( <£ ) 


04 


Ob bT^kT-uAY 
DATfc.-COiSPLt.Thu- 


Pi OOP:. 


i b 






Ob 


COMPLETED -YEAR 


P I CTuPc. 


1 b 


y • 




Ob 


COMPLETED UN TM 


PI CTUPt. 


I b 






Cb 


cokpleted-lay 


PICT oPu 


lb 


V ( 4 ) 


04 


UNIQUE- I A- ID 


P I CTUPL 


9 C 3 5 , 



RESO'JRCE-F 1LE RECORDING MODE i 3 til NARY HYPtR DENSITY. LAUEL 
RECORDS ARE STANDARD VALUE OK l DENT i h J CAT i ON lb (*>RL SOURCE -D AT 
A-F ILL® L'ATA RECORD lb KuivoKUt-oATA-l- lot. 

01 RLSOuRCt-DATA~K ILL . 

02 F I XED-LENGTH-RECORO. 



Ob 


TYPE -OF -RESOURCE 


PICTURc. 1 


b 


* . 


03 


SERI A L -NUMBER 


PICTURE. ; 


b 


V ( £ ) • 


Ob 


NAME -OF- RESOURCE 


PICTURE 1 


b 


A { 1 b ) • 


Ob 


CAPAC I TY-OF -RESOURCE 


PIlTlRu I 


b 


V( b) ♦ 


03 LENGTH— OF —COMM 1 TMENT -REC 
COMMITMENT-RECORD OCCUt-S 1 TO 


PICTURE 1 
20 T I MES 


b 


V< ) • 



DEPENDING ON LENG TR-OF-COMM 1 TMENT -NEC • 
00 COMM! TMLNT-RLCOPD-OATA. 



04 


DATL-OF-COMMI THE NT 


PICTUKl 


lb 


9(4). 


04 


HOUR-OF-CONMI TK.EN7 


PICT C a l 


lb 


A ( 1 ) ♦ 


04 


TOT AL— HOURS -COi'i. v i ) 1 TtO 


PI CTOPh 


lb 





TOO" 0 : ’ ! 7IN ' ' '"'Cl'Y-BEST 
AV/u'USLc Ai TIM 1 ! HIMtD 




may reference all the legal IA choices that a studci i may make, and 
thereby chock each asserted student IA choice for a given PC against 
those I/Vs specified for its preparation. Similarly, given a number 
of student choices for a legal IA, we may tic that set of choices in 
summary to the corresponding resource record by virtue of the cross- 
reference between resource and IA provided in the IA records shown 
in Tabic 2. 

The PC and IA files, of course, will contain the variety of 
entries specified in Tabic 1 of the last division. 



Fil e cro ss reference. A careful study of Table 2 will reveal that 
each of the four files mentioned above is even further interrelated, 
and that the set of files as a whole may be considered as a planning 
package. 

To illustrate, the student file relates each student to the PC 
file by means of the student’s choice sequence of PC’s, which, if 
that historical category in the student record is used, also gives 
a student IA cross-reference. 

Similarly, the PC and IA files can be related to the resource 
file, as previously noted, so that proposed student PC and IA choices, 
as obtained from the student records in summary may be expanded into 
specific, resource projections for future planning, as well as for the 
development of historical statistics of actual PC/Ia and resource use- 
by virtually any breakdown desired for management reporting. 

Using the proposed file structure, for example, we may determine 
the efficiency of resource use by category (or by individual resource) 
study proposed student choices versus actual results (both by category 
and over time), determine the frequency of PC and IA choices and their 
utilization (a number useful in grouping or expanding the PC and IA 
offerings), and also make a number of statistical analyses of student 
background, history, and performance, as they arc related in combina- 
tion, (Appendix A to this report indicates a random selection of over 
fifty questions that may be answered for management purposes by a pro- 
per manipulation of the file data proposed here.) 

As a technical point, note that the student file, which is here 
proposed for tape implementation at the present time, is easily ex- 
pandable for more students as well as more PC's and more historical 
items per student. On the other hand, the resource file and the PC/IA 
combination file presents a technical limitation upon file item count, 
or file length. T n the latter case, for processing ease, the PC/ 1 A 
and resource files have been planned for storage in the computer's 
highest speed, and most costly form of memory device (core storage) 
so tli at processing of intermediate detail need not be detained by the 
need for sequential file search (as opposed to direct, or random, 
access to the information needed), 
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File Jo run t_ mod i f i c sijL i on . ‘Ihc files shown in the detail of iable 2 
are not supposed to ho in the most efficient format that may bo possible 
once the use statistics of PC's, JA's, and resources arc known, Indeed, 
we fully expect that a later reformatting of all of the specified files 
will be both desirable and necessary to achieve the greatest processing 
efficiency, as well as to achieve improvements in management control of 
the educational system. 

We should note, however, that the essential categories necessary 
for planning and statistical, use analysis have been provided in the 
stated design of Table 2, and that later reformatting, reorganization 
of files, and requisite simplification can proceed on cm automatic (i.e., 
computer programmed basis) if the initial data have been collected in 
its detailed form as shown. Thus, we may easily group, eliminate, and 
otherwise reorganize the detail if it is at first present, and for that 
reason, we have entered into the initial file design those categories 
which to us appear relevant to the current problem, or its forecasted 
sequels , 

As will be evident later, however, it was our intention in speci- 
fying the files of Table 2 to provide sufficient generality of design 
so that later moves to, say, real time as opposed to batch processing 
would not necessitate complete loss of our previous work. Indeed, 
with relatively simple recoding and reformatting of the presently 
suggested files, the proposed system could be moved from a batch 
operation, as. specified in this proposal, to its real i imp counter- 
part using remote terminals and the airline reservation analogue 
when such a move can he justified economically. We believe the real 
time alternative not to be feasible economically at present. 



File Processing and System Oper ational Procedure. Figure I illustrates 
the procedural sequence for operation of the proposed management infor- 
mation systematising the four files described in Table 2. 

First, commencing at "STAUT” the system is initiated by the 
creat ion of the student file, the resource file, the PC file, ana the 
1A file from current planning data (e.g., what rooms, people, and 
equipment arc available, what PC and 1A types are available) and from 
incoming student records. 

Then, the procedure starts with an initial prccommi tinent of 
students to PC’s and their corresponding 1A choices, either through 
counseling or by standard starting criteria. Once this initial as- 
signment lias been made, the system now proceeds to cycle. As reasoned 
later, we suggest a one-week batch processing operation for initial 
experimentation. 
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File Proce ssin g Se quen ce f or Man agement In formation Sys t ejn . Optical 
inputs, lettered A through E, provide file update after initial files 
have been created. Periodic reports, numbered 1 through 5, provide 
information for counseling, scheduling and management control. De- 
tailed structure of files, input records, and reports is discussed in 
Lest. 
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I njnrt Transaction Types anti Output. Reports. In Figure 1, wo show five 
types of input; transactions , identified by letter and indicated in the 
figure by dashed boxes, and five output reports, identified by number 
and indicated in the figure by double-lined boxes. 

As u consequence of t lie initial student PC*- ] A set of combinations, 
we may generate (1) a student status report, showing in whole, or in 
part, the student's current record of assignments together with as much 
background data as may bo desired for counseling, (2) an error report, 
indicating illegal PC/IA combinations, data input errors of other types 
and such detail as may be needed for technical correction of procedural 
processing errors, and (3) a resource analysis report, indicating in 
summary the resource need in relation to the selected PC/IA combination 
In later cycles through the procedure, it is intended that the student 
be able not only to confirm certain PC/IA schedules, but also to indi- 
cate Ids intent to make such selections, so that the later resource 
reports will indicate t he resources needed to fulfill future student 
demand. 

Thereafter, the students pass through their experiences, and as 
a consequence of them generate a number of inputs (11-32) through coun- 
seling, through testing, or through plan alternations which may occur 
in the interim. Similarly, alterations in available resources arc 
also entered here. 

Thus, the next inputs are student "grades" recorded as "pass" 
or "fail" for a given PC, counseling input of desirable future PC 
and I A choices, resource changes that may be necessitated from time 
to time (additions, deletions, changes in capacity, etc.) and updates 
to the student file (student additions, deletions, protest results, 
transfers, repetitions of PCs, etc.). 

Kith bis data in hand, wc may then repeat the update operation, 
M is tiv 1 r planning purposes of the administration, not for the 
student. Tii sr-^ndary run, indicated in the solid box above the 
transaction iiqut (il-1:) produces two reports numbered (4) demand 
report, and (5) resource available report. The purpose of these 
reports is to facilitate internal resource planning, i.c., the an- 
nouncement of the future availability of specific PC/IA choice cate- 
gories. Hi is step presupposes that both students and counselors arc . 
at the time aware of student "grades" in each PC, and arc aware also 
of any individual student changes in status reports (an intermediate 
copy of student status report (]J can be provided on special request 
for individual analysis). The latter still remains on a batch basis 
in the present scheme. 

With reports (A) and (5) in hand, we move to two unnumbered 
dashed boxes, which indicate manual operations of scheduling decision 
and PC/IA offering for the next cycle period. 
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Wc now pause in our system description to discuss the reasoning 
and logic, behind the manual planning steps. 



Scheduling and Allocation of Resources to Meet Demand. In the pro- 
cedure of figure we purposefully left to manual and human operation 
the development of schedules and resource allocation, although it might 
appear that this is one step in the overall system that should have 
been automated. Because of that step's difficulty, wc reasoned differ- 
ently. 

First, most existing computer programs that successfully schedule 
students, staff, and resources, arc not algorithmic, that is, they do 
not proceed by a mathematically defined step-by-step sequence to a 
guaranteed solution. Rather, the successful procedures arc highly 
heuristic, which is to say, they use rules of thumb or experience, 
however sophisticated, to generate t he final plan. (For the current 
state of thi ’ art, sec Chapter 4 of Cuadra, op, £it. , which reviews 
applications through 1963 for both schools and job shops.) The neces- 
sity for this Trristic trend appears in most scheduling problems of 
any consequent , since most arc too complex for present (and perhaps 
forseeablc) algorithmic implementation: the mathematical procedures 

that might work in such combinational problems are net known at present, 
and, if they wcu. e, the computational time required for an "optimal 11 
solution by such techniques would likely be excessive. In fact, the 
problem of scheduling job shops, to which the MbTliP educational pro- 
posal is analogous, is one of the most difficult data processing tasks 
that can be imagined. So we stepped around it, knowing that we faced 
a situation of ultimate variety and human concern. 

Second, it was our hope that by leaving the scheduling problem 
to humans, on a decentralized basis, we might learn what heuristics 
might apply and be humanly acceptable in this case. We were not dis- 
appointed by this approach. 

Commencing in September 1969, to the date of this report, the 
pedagogical team leaders at the University of Massachusetts School 
of Education were confronted with the problem of scheduling their 
resources and their students as best they could. They succeeded with 
their experimental groups by a variety of methods, most of which 
invoked the same principles of simplification previously discussed 
in Divisions 1 and 2. 

Without going into excessive detail, here arc two approaches 
that were used: 



In the mathematics area, a four-week time horizon was developed 
for scheduling personnel and students, with an IA sequence of that 
duration which would lead to the preparation for a number of grouped 
PC's. To provide flexibility, however, this offering was repeated on 
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staggered starting dates displaced one week each in time for four offer- 
ings. Thus, although the staff and facilities could bo planned for in 
advance, a student could place himself in any one of four groups, and 
pick up the progress in any one of them as lie selected. This practical 
method provides the illusion of flexibility in combination with the 
actual rigidity and look-ahead required for stable planning. And, in 
coming to this practical result, the personnel involved began to ap- 
preciate the necessity for .simplification, even when electronic c cm-' 
puters are available for record keeping. In performing their simpli- 
fication (by grouping JA's), the personnel employed their highest 
human talcnt.s--that of pattern recognition and the exercise of value 
judgments in decision-making. 

In the language arts area, a completely different approach was 
used. Although a five-week time horizon was selected, and formal 
lectures developed daily for that period (with one IA experience for 
each PC), here too the need for advance pre-planning was recognized 
and exercised. To provide flexibility for this fixed segment of li^c 
presentations , this group chose to record the live material on magnetic 
tape, which presented an alternative set of possible experiences for 
students who missed or chose not to attend the live performances. 

The scheduling of students to the live offerings or to the alternate 
tape experiences was conducted within this area on a student signup 
basis. For example, tape playback equipment was on a signup basis, 
so that students themselves assumed the burden of ihe.i r own commit- 
ments--cvcn though the facilities were fixed in capacity over time. 

In tills instance, checks of student progress were maintained manually 
(in fact on a large chart on the back of the supervisor's door) so 
that the total picture of group progress involving 125 students 
could be monitored. r llie latter record of results is easily automated, 
although the scheduling is not. This successful supervisor also 
walked around the problem of scheduling by having the students schedule 
themselves informally, and only retained the results of the student's 
own efforts for analysis and review. 

With tli i s experience in hand, we see no reason why there should 
not be a diversity of planning and scheduling methods in the total 
system, nor why this is not a beneficial policy for teacher education 
as well as an economy of processing and control efforts. Indeed, the 
only essential wc sec to bring these diverse methods together in the 
whole is to provide the departmentalized planner. me guide to pro- 
spective student demand and resource need as well as to provide 
reasonably current records of individual student progress for review, 
as provided by the sequence illustrated in Figure 1. 

In this vein, at a meeting on November S, 1969, we agreed with 
the pedagogical team leaders that a onc-wcek planning and reporting 
period would be more than sufficient for implementation of the present 
plan, and that such a data processing effort was feasible, provided 
the area supervisors scheduled their affairs as they had already done, 
of necessity in their experimental trials in periods exceeding one week. 
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C on iploti o n of th o Processing Cycle. Returning now to the details of 
Figure I /we propoTeTluit^ as IT consequence of the administrative plan- 
ning resulting from reports (<1) and (5) advance offerings of PC/1A 
combinations be mode available to students, preferably as far in ad- 
vance as possible. Such offerings, when limited, can be handled on 
a manual basis; or, if extensive, can be chocked for feasibility 
against the resource file os a special run, (In this step, iu may 
be desirable to have the resource file available to a limited number 
of planners on a real-time basis, although not to students. One or 
two administrative planning terminals, even at this time, may be 
justified for trial -and-error utilization of resources in advance. 

Such intermediate administrative experimentation may reveal more 
effective heuristic rules for future planning, and we consider this 
step a potential benefit in teacher and administrator education. 

This possible intermediate experimental sequence is not shown in 
Figure 1.) 

We forsee that the result of t lie human scheduling effort noted 
above will be made available to the student body as an upcoming list 
of offerings which may be committed, on a first-come, first-served 
basis. Thus, to cite one practical method of implementation, limited 
resources could be reserved by students by their own signup until the 
resource was exhausted (as noted for the language arts experience to 
date) or handled manually on a large display board for room and equip- 
ment assignments on a group basis. 

Regardless of the method of student-resource commitment , wc 
end up witli that cross- reference for historical purposes and can now 
input it into the system, via the student input transaction, labeled 
(A) in Figure 1. 



Data Inp ut Forms and Means . We have suggested elsewhere that optical 
input forms be used, even for th e weekly update system proposed as a 
starting system, 'this foi'm of input is easily organized, and eliminates 
the intermediate cost and delay of card kcy-punching, presently familiar 
in industry. The optical form of input is natural in the educational 
setting, since the same equipment can be used to accept student and 
counselor initiated input using a pencil for both file updates and 
test administration. (For example, a typical device for this purpose, 
the higi -tek optical reader, is widely employed for test scoring, and 
can be programmed to provide cither test scores or data cards for 
direct computer input. A highly underutilized unit of this type 
happens to be available for interim experimentation at the University 
of Massachusetts . ) For alternatives to the optical input in our 
proposal, sec Division Four* 
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Data Output Forms and Means. At the start, we propose that data out- 
put reports he provided in hard copy, or paper form, Using this proven 
approach, each student and counselor can I c provided with a permanent 
historical record of commitments and progress. Similarly, an easily 
read historical record can be made available to administrative planners. 
In later modifications of the proposed system, it is possible, first 
on a limited, then on an expanded scale to provide students and planners 
with access on a remote terminal basis to immediately pertinent data 
should that be necessary as cycle times are reduced. However, with a 
one-week cycle time, and hopefully a more lengthy planning horizon, 
we see no present necessity for a real time inquiry, with tin: possible 
exception of administrative pl;nniing“pejTiaps using simulated planning 
tests as described in the simulation section. 



Some Teebni cal Prograoung DetaUs. Pol lowing the present technical 
trends in management, information processing design, we propose that, 
wherever possible, programs written to implement the suggested pro* 
cedurcs follow a "format independent" style in which data formats 
used for hot h input and output can be changed at trill as possible 
file improvements change the data base, or file structure. 



'fins feat is possible for input change 
supplied record, or header, which precedes 
which itself spvCi Pies tnc format in vv i < 1 eh 



s by providing a file* 
the normal data record s, 
t * i c later records tv ml 



appear. lints, although a computer program may be written peneraijv 
titu precise format of each data entry may be left to t lie tine of 
execution, ami a standard processing procedure may by this means be 
made amenable to variations in entry formal, litis form of advanced 
programming is highly desirable for processing experimental files, 
and is suggested in this ease. 



Similarly, by separating the main processing program from final 
output editing and report generation, and by furthei transfer of the 
modified input formats to later editing modules, as is possible with 
advanced programming techniques, which we shall not go into here, to 
make output reports data-base independent in regard to shifting input 
file formats. 



Although this Approach is not widely used at present, wo suggest 
that it is desirable, as well as feasible, for Hie system heretofore 
proposed, and that , because of the likely changes in the I’C/IA files 
in particular, future investigators heed this point with care. (See 
Cuadra, op. c i t . , Chapter 4, summary conclusions . ) 



The Man agement Information System _nndJHher Ilf 'forts of^ this Ppej cep . 

The management infernal ion system described in this section is tied 
directly to ether parts of this rcjvart , especially the simulation pro- 
jects and trials (see Section V) and the ether management policy recom- 
mendations (sec Section III). 
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Seldom do administrators or usoo of an information system ap- 
preciate the variety of questions that may be answered by specification 
of inquiry categories from even a limited set of those available, nor, 
regretfully, do they often appreciate the difficulty, both human and 
technical, which nay be encountered in answering questions that have 
not been anticipated in advance of their need. Appendix A wi J 1 illus- 
trate 1 110 former ability, but only foresight can assure that the infor- 
mative detail that may be wanted on a historical basis will, in fact, 
be available when requested. 

'Hie information system proposed in this section as a feasible design 
for the MHTlir projects implementation provides r.n exceedingly wide range 
of information. Vnc system proposed also provides close control of short 
term plans at Minimal cost, a topic which is the subject of the next divi 
sion. But, the system as presently outlined docs not presuppose cover- 
age of all inquiry types that could occur in management crises of the 
future, 

Our suggested design is not for instantaneous status inquiry and 
instantaneous planning 02' for long range prognostication or control of 
strategic educational values. It is a bench mark system from which to 
work, both in cost/effect ivencss evaluation and Inter systems analysis 
on an intermediate time scale basis. 
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Division Four 



We now turn to a discussion of system costs, benefits, and sug- 
gested extensions due to future economic and technological changes, 
first consider l lie bench nark ease of the last division. Then, t;e 
progress through an analysis of eight other alternatives, specified 
by widely differing values of student PC volume. By tins procedure 
we reject six of the nine alternatives as unfeasible, and finally 
concentrate upon the three remaining feasible eases, finally, v;o 
turn to more detailed adjustments from the bench mark. 

Pricing the Bend. Mark Case. ^ To provide a starting point for cost 
estimation, we have made the following assumptions: 



1. 


Students 


in system: S00 




2. 


Number of 


PC's in file: 1 , 000 




3. 


Number of 


PC's to completion: 


300 


4. 


Number oi 


years to completion: 


Two 



7 

The numbers used in this costing comparison nave been selected to pro- 
vide ease of computational understanding, and are romewhat different 
from those indicated in the simulation chapter for several reasons. As 
previously noted, the simulation data included SSI PC's and 948 IA's. 

Of tli c SSI PC's listed for the simulation, n 1 J_ were required c'f each 
student, except those pie-tested successfully. The requirement for 
conviction of the total list was a technical requirement of tho early 
simulation program, since no data was available on the probabilities 
of student elective choices of PC alternatives. After pretesting, 
the number of PCs required of the simulated student dropped to about 
400; and, to obtain graduation in reasonable time periods, the simula- 
tion showed that only about 70* of those 400 PC's could in fact be re- 
quired due to resource conflicts over line. 

The net effect is that simulated students usually "took" roughly 300 
PC's, as shown in this section. Ihn authors of this Section believe 
that the student choice of 300 from 1,000 possible PC's will more •* 
nearly approximate operating reality than the "total" or "70"." require- 
ment assumed in the current simulation. Moreover, the following argu- 
ment and its comparisons follow from the transaction rates demanded 
of the information-processing system as the number of required PC' s 
to graduation increases, so tlat the straight forward arithmetic used 
hereafter can be modified with ease if the total number of PC's required 
increases or decreases. Ihus , giv-n the explanation above, the re- 
mainder of this Section is completely consistent with the simulated 
results, as well as with what we consider to be operating reality. 
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5. i lx \ irb^c nJT j la ys per academic year: ISO 

6. Nui;ibc)'_of ITV:; r^npn i\ 0 j>er_c!ay for two year completion: 

*300 YCf^/Ydd days ** = ~Ti'\l per ~a cVJ e T f: i c day* 

7. Number yf of IT olive transact tons per VC: Two (One initiating 

a PC ami one iciminnting a 1'C.) 

8. Poss ible va/lnt ions in Transact ion inj.iMy Pcpending upon the 
advance schoduJ ing volume and firsi-tiue scheduling success, 
the number of transactions estimated in (<>) ami (7) may vary 
upward, e.g., if several transactions are required to schedule 
for one PC, if several tests arc required, if PCs arc re- 
peated, dropped, etc., the number of transactions per day 
could easily double or triple. On the other hand, if PC’s 

are more tightly grouped, if students batch their transactions, 
say on multiple entry ferns, and if mostly historical, rather 
than scheduling information is maintained in the files, the 
number of transactions cculd drop to loss than our estimated 
two per day. tt is onr hope that every day pressures will 
cause the latter route to he followed by the system’s students 
and administrators. If this is so. it is our opinion that 
one effect will offset the ot.ner, ami that our estimate of 
about two transactions per day, as computed over a week or 
a tenth, wj 1 1 hold. it is on this assmr.pi ion that our 
further cost estimates will he made. 

9. list i mu ted cost per transaction: Twenty cents each. This 

estimate includes the cost of input forms, data conversions, 
computer processing, and output report generation on a weekly 
basis. The effective cost per input transaction may vary 
upward or downward from our estimated figure depending upon 
the frequency and variety of special reports requested and 
provided. Onr estimated transaction cost excludes (a) those 
personnel costs that nay bo associated wi th test adiainist ra- 
tion, (b) those pei sonnol costs that nay be associated with 
human analysis of output repot ts, c.g.. for counseling 
purposes, (c) overhead costs associated with space require- 
ments, ami (d) costs of manual scheduling ns required for 
the proposed system. The estimated cost of twenty cents per 
transaction is based on experience with similar record- 
keeping systems, and is not based on detailed timing of 
computer runs nor upon the simulated system runs of the 
overall system, discussed elsewhere in this report, finally, 
the estimated transaction cost docs not include the costs of 
original file construction, nor the costs of programming the 
proposed bench nark system. These one-line costs will l*.e 
treated separately hereafter. 
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10. _l)irect cost per student per ye ar. Based upon tlvc above 

assumptions , v.e arrive at a cost per student per year of 
$60 = 2 transactions per day x 3 f(l days per year x $0.20 

per transaction. (This figure is about 2* of total educational 
costs with present methods of instruction, which average $3,000- 
$4,000 annually.) 

11. Total record keeping cost annual])' for the bench tm*k systet.t. 
based upon S0d scudents in the system, a direct r.uit ipi i cat ion 
provides a direct cost of $48,000 annually fur the system. 

12. Added _eos_t_ for ove rhead items. $40 per student per year. 

Of this total, $16 way be attributed to vhe creation and 
maintenance of student master files (including initiation 
of and changes to the student header record) as well as 
incidental maintenance of other master files not related 
directly to student transaction volume, and $26 nay be at- 
tributed to special reports, and personnel costs required 
for manual scheduling. 

13. Tot al cost pe r stude nt. Tuns, in total, we have $100 per 
student per year for the bench mark «ystcn--sti 11 excluding 
costs of testing and counseling. This figure note represents 
about 3T of the student's present educational cost, or about 
2\ of projected costs per student under the more flexible 
Mis J M' educational philosophy, (5tv icpuit section on cost 
fcasibi 1 i ty . ) 

14. Total s yste m cost. Again, following the line of progression 
above, with an $U0 member student bod) - , at a total of $100 
per student, we have a total information system cost of 
$80,000 jicr year. 



Benefi ts As sociated with th e be nch Mark System. The bench mark system 
offers a ntirilTcr of features not easily obtaTnod from present methods 
of record keeping. Since the cross* reference between the four files 
(Student, Resource, PC and 1A) provides flexible combinatorial analysis 
of results, the system provides a data base for later analysis of what 
was planned versus what actually occurred. This comparison forms a 
basis for management adjustment and control of the system as a whole. 
Although this feature may be enhanced or degraded by an increase or 
decrease in file complexity and the detail of transaction reporting, 
it is our belief that minor deviations from the level of detail sug- 
gested will provide little if any direct benefit changes. Moreover, 
the bench mark system provides continuing plan versus accomplishment 
records for the student so he may monitor his own progress on a more 
frequent basis than is usual in present academic record keeping. It 
is our belief that with this additional information, the stuJent will 
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in many cases be his own self-correcting agent, thereby stimulating 
student Motivation and self analysis which might not otherwise be 
prevalent. 

Another benefit is the provision of intermediate data for short- 
term planning and control of resources and an analysis of their utili- 
zation, including some advance knowledge of future student demand to 
permit planned flexibility in the scheduling effort, finally, the 
proposed system provides sufficient detail for statistical analysis 
of the student population versus planned offerings and the resul ts 
obtained in total, litis form of data will itself he useful for both 
educational purposes, e.g. , student projects, and academic research, 
c.g. , faculty analysis of teaching methods, sequences, and timing 
of modular presentation. 



boss ill 1 o Applicat i on_ Pi f ficul t ics o ft l.e bench Mark Case . A ! though 
a one week period for botching transactions nnv be sufficiently long 
to prevent major peak loading problems in the system, particularly 
if resource planning is carried out in longer prc-cotr.ni tinent blocks, 
say one mouth ahead with weekly adjustments in planning for the most 
forward week only, we cannot now forecast the transaction or special 
report load variation that may occur. This is a point to watch care- 
fully in application, since rapidly shifting load levels tiny be as- 
sociated with a rapid increase in the estimated transaction and report 
volume. This phenomena i.uy result ns both planners and students 
attempt to correct errors or temporary misal ilocat ion of available 
resources. That is to say, the stability of the total information 
system's operation, as is the ease with all information control systems, 
will be dependent upon demand fluctuations, processing cycle tines, 
and planning lead times in combination, hitbeut some degree of system 
stability, planning breakdowns, and frantic efforts on a short tern 
basis to make adjustments can defeat the system's planning value as 
well as generate volumes of transactions and rcjoits which can becloud 
the historical patterns that would be useful for statistical analysis 
and future planning comparisons. 

Another general problem to be monitored is that of file security 
and confidence. Although this problem is most severe in real time 
systems in which many data input units can be used to access the same 
file and alter it (a method wo do not presently advocate), similar 
difficulties can also arise in even sinplc batch systems if trans- 
action accuracy is not constantly cheeked, and if strict processing 
controls are not instituted as historical files arc updated and re- 
ported from. Particularly at the early stages of implementation of 
the educational information system, we would anticipate Some user 
confusion, and a number of errors that will demand specific imple- 
mentation measures to avoid. 
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We anticipate* for example, that in initial file const ruct ion, 
and in later transaction acceptance, the implemented computer programs 
should themselves screen all input and maintain error statistics for 
later system improvement. Such an error report was built into the 
design of figure I for this purpose. In particular, the student PC 
history record, which culminates in the student's graduation, must be 
secure. for ibis reason, we suggest that student test results be 
transactions which only a few authorized personnel may input to the 
system. In the absence of such u safeguard, a number of obvious abuses 
could occur. 



Progronjning and Testing Costs for t he Bench Mark _Casc. Systems of the 
type described here have a current price of between $10,000 and $20,000 
for final system design programming and testing using hypothet ieal , or 
limited amounts of real data. 'Hie generation of sj)eciaJ_ reports, of 
course, represents an additional programming expensed Ihe total 
package will be in the $30, 000-$d0,000 range. 

Although a number of generalized file processors arc currently 
available (see footnote 4 ) most arc restricted on to file analysis 
and arc not intended as control systems. Moreover, these systems 
(on a one-time lease basis) cost between $2O,OO0-$1OO,OOO, and in 
many eases offer features which arc not needed here, which require 
excessive high-speed memory, and which often require excessive run 
t imes - 



Thus, v;c would prefer to have a program package written for this 
special case. Although such a program package should be written 
generally, so later alterations in file design would not destroy the 
programming effort, we would foresee it to be of modular form so that 
individual modules could he employed when needed exclusive of the 
others. This remark applies especially to programs involving the 
PC/ 1 A catalog, which for speed will undoubtedly have to be stored 
in the computer's high speed memory. (Present estimates of this com- 
bined file is about 11,000 computer words, which is a substantial 
portion of the usually available memory.) 



^Current programing estimators have found froia historical experience 
that a finished program after test and correction, costs $10 or more 
per statement, or program line. That figure is higher for highly 
interrelated program systems. (Typical supervising control programs 
run $20-$30 per line, and very complex systems, such as the SAG!; early- 
warning system developed for the military cost over $60 per line.) The 
bench mark system, we believe, is in the $10 per line level of com- 
plexity with an estimated 1,000-2,000 lines required for the several 
programs necessary for the bench mark package. 
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/. summary of tlic total development and operating costs over a five 
year period have been prepared for the bench nark ease and appear in 
the Economic feasibility Section of this report. 

Variations from the bench Ma rk Case. For the sake of discussion, 

Table 3 proposes several wide deviations in scope of processing from 
the bench mark case, which is shown at the center of a 3 x 3 cost table, 
'flic figures shown in the table are estimated cost per student per year, 
as outlined above, but in this instance for various combinations of 1C 
variety (count) and student population size*. Again, the figures shown 
arc estimates, developed in the manner previously illustrated. Kc are 
not interested in tiro detail of each number litre, but rather the reasons 
for the relative differences in estimated cost, os well as possible 
changes in system effectiveness us ve move from the bench mar).. (In 
a later section, we will discuss how the figures of Table 3 may be 
altered by rapidly changing computer economics.) In Table 3, we assume 
that a student must complete 30^ of the PCs offered, implying for a 
fixed time period of two years that PCs will represent shorter segments 
of scheduled time as we move to the right from column to colusin. 



TABU! 3 



liSTIMATliM COST/STUDEXT PER ACADEMIC WAR VfeRSl*.S 
PC COUNT AM!) S!I!E OF STUDENT P0PU1.AT1ON 

(Presently Feasible Selections Arc Shaded 
for Emphasis. See Text for Details.) 



PC Count 



100 1000 10,000 




Consider first row one of Table 3, which represents » 10-student 
population. Kith this small number of students, a simple manual record 
(a file folder for each student) is satisfactory. And, at the 100 PC 
Kvel, simple manual summary and planning arc both possible, and most 
economic, even as a part-time teacher effort, although $10 per student 
year is shown for the sake of i 1 lust .at ion. 
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As wc move to the right in row one, tlio number of students remains 
at it), but the number of l'C choices increases by orders of Magnitude. 
Thus, for 1 CI00 PCs, of which the student irust now complete 500 in two 
years for graduation in that time period (foliowing our assumptions), 
the length of the student file increases, and the detail for planning 
increases also. Kc arc on the borderline of an electronic computer 
application if extensive statistical analysis of l’C use is desired, 
even though student records themselves may be maintained still by 
manual means. The increase in cost may be attributed to the increased 
manual effort required to update each student file (about two trans- 
actions per da)' as in the: bench mark onset and the increased difficulty 
of either Inman or computer analysis of PC use and l’C planning. Hie 
total number of transactions for the student body is still relatively 
small (about 2.0 per day) and it could be easily bandied by one clerk 
on a part-time basis. The $50 per student, for example, provides $500 
per year for the ten students, and is equivalent to direct costs, 
excluding overhead, for 20 days at $25 per day for clerical effort. 

Again with lm students, but not; with 10,000 PC's, of which cac!i 
student must now complete 5,000 to graduate, we come to a case which, 
even for the few students, begins to push manual methods to their limit, 
for example, even with ten students, we have potentially 50,000 items 
in the total student hir,tory--a number which is perhaps susceptible 
to human analysis (considering that many of the 10,000 PC's arc likely 
never to lie selected), but which is on the face of it a studoiit/f'C 
cor. bi nation not likvly to bo found in practice, inns, although the 
record keeping may be feasible on a manual basis, we would expect 
only a very casual form of analysis on a semi -automat ed basis, perhaps 
using the librarian’s form of centrally punched cards (often called 
"pcck-a-boo” cards because they are analyzed by humanly viewing punched 
holes over a light source). One such card per student can contain 
punched records for up to 10,000 items (PC’s) using very simple mech- 
anical .and optical equipment (in the $1 ,000-$r ,000 class). Kith a 
combination of such techniques and some manual notation both student 
and l'C records could be maintained. Nevertheless, who will offer 
10,000 possible choices to only ten students? The volume would not 
be sufficient to justify tire resources necessary on any basis that we 
can think of. Our figure of $500 per student is the cost for one clerk 
to do what she could on a full time basis (at a cost of $5,000 per year 
for ten students, or $500 each) . Hie number need not bo exact, since 
this case will not come to pass; wo show the figure only to indicate 
that a substantial increase in record keeping cost would necessarily 
occur, even with minimal record detail. Kc leave for others the 
problem of figuring out how to provide the 10,000 PC’s to the ten 
students. 



^R. S. Led ley, Programming and Util isin g Digi t al C omputers, McGraw-Hill, 
New York, 1902, pp. 50i- 505. 



Row two of Table 3 represents the bench mark number of students. 

With you students am 1 only 11)0 PC 1 s kc have a situation in which niinimal 
computer processing efforts can be? of benefit, 'ihc cost of $23 per 
student assumes that v:c Kill batch results only once end: tern or twico 
per year. Since only about 13 PC’s need be planned for each year, re- 
source and student scheduling way be handled in large tine segments, 
i.c., In one tm,i, or even hr If -term blocks, 'ihc 1**2/ h\ catalogue is 
brief, unders t amiable , and easy to automate for record analysis, And, 
because of the increased studoiU volume and the fewer PC's we have 
an attractive cost for rcccrd-hi ping. At $25 per student, and COO 
students, wo have available $20,000 per year. Assuming a system de- 
sign similar to the bench mark case, but with less fiequenl belching 
and longer range planning, this sum is adequate to maintain the lessor 
butch mark system. It is little winder, for these reasons, that she 
800 stuJcnt-100 PC case is the one* which most nearly approximates 
present da)* educational record- koepi ng efforts. The shortcoming of 
this case, of course, is that it does not offer great st udent -choice 
flexibility, which is one of the prime proposals of the MI-TIIP proposal. 

It represents, essentially, the stj^lus^ cmc>. 

Moving to t lie right in row two, we encounter the bench park case, 
which needs no further discussion here. 

Final]) 1 , the third column in row two, the 800 studont-10,000 PC 
case, provides an interesting departure. At this tewi of assum- 

ing n two year completion pei iuu ami 3,000 to complete, we have about 
10 PC's to complete per day, and an expected 20 transactions per day 
per student (for 800 students a minimum of )f,000 per day and undoubtedly 
up to twice that dus to repeats, drops, and schedule conflicts), 'ihis 
is an entirely different game, even forgetting moment nr i J.y the resource 
planning problem. This case demands a real tro processing system 
with many input terminals, a computer dedicated to the single task of 
master file maintenance, and vastly increased clerical costs, if any 
forn of file security is to be maintained, lor example, this level 
of transaction volume requires at least ten input •output terminals, 
e.g., 1G00 transactions per terminal per S-hour day is 200 transactions 
per hour, a feat which is hardly possible with clerical input of any 
form if student transaction confirmation is immediately desired. A 
more realistic naxiinim figure is 00 transactions per hour-- even as- 
suming the most sophisticated output equipment and some conversation 
with the student. Ibis easily pushes the number of needed terminals 
to 23 or 30 as a minimirr, witji sujicrvisjon ( r 'r thoiv use. Such re- 
quirements present total annual costs of iuHM’Ot 1 (provided ly 800 
students at $800 per year). The per student figure of $800 annually 
now approximates over 25* of a student's current total educational 
cost, a ratio we believe to be unacceptable. Tor this reason, the case 
is not feasible in our view, particularly when the resource variety 
and planning required to maintain an on-going operation at this level 
is considered. 







Now, turn to row tliroc, column one. Here we encounter ocono;rucj^ 
of scale. With the increased number of students to torn an economic 
base, we have available $10,000 =* $20 x 5000 lor data processing. 

Since the necessary system is still simple, requiring only infrequent 
batch processing, siji])lc planning, and fewer controls for security, 
the $20 figure is entirely realistic, and indeed generous. Moreover, 
kc have built enough volume for our PC list of 100 to provide an 
average 50 students per PC--morc than enough to produce economies 
throughout the entire system. This, then is a highly feasible com- 
bination of volume and variety, and in addition one in which automation 
of the planning effort can be centralized with relative case. 

The most interesting comparison is between the first and second 
column of row three, as wo move from 100 to 1000 PC's. At this level 
of volume and variety, we generate a minimum of 10,000 transactions a 
day (3000 students x 2 transactions each ns in the bench nark case). 

This load requires greatly increased input /output facilities, even 
though they need not be on a batch basis. Thus, \:o have greatly in- 
creased clerical costs for data preparation, with greater controls 
necessary to avoid gross confusion. Although this case docs provide 
so no economies of data processing, any such cost reductions per student 
are offset by input/output, planning, and control supervision costs 
which increase more than linearly. Moreover, counseling and testing 
(a Subsidiary issue) increases also at a no re than linear rate. So, 
nur processing estimates run in this case \ o $500,000-$! ,000, 000 
annual 1/ foi the total record keeping system, or, say to SI SO per 
student for illustration. This per student figure does not include 
testing and counseling, nor the highly possible problem of extreme 
load peaking which will vastly increase the cost estimated . Tints, 
contrary to popular belief, we do not believe that increased volume 
is necessarily a benefit when the number of PC choices is in the range 
of 1,000 or more. In fact, based on our previous discussion, we con- 
clude as student volume goes up, it is desirable to reduce centralized 
PC choice detail --or take other organizational alternatives which 
will have the same effect, such as decent ml i zed planning and record- 
keeping, with summary reports onl y entering the main system. 

Finally, we come to row three, column three, n ease which on the 
face of it is not feasible economically for any foreseeable educational 
system under present technology. Here we have 5,000 students and 10,000 
PC’s, of which 3,000 must be completed in a two year period under our 
assumptions. A simple computation, based on our previous figures for 
column three, indicates a transaction load of 20 per student per day, 
which for 5,000 students produces an average of 10,000 transactions 
daily. That startling figure nay easily be doubled due to changes, 
drops, test failures, etc., so we now approach both an input/output 
and ical time processing requirement which approaches the complexity 
and cost of a Major airline reservation system. Again, we have some 
potential for processing cost reduction, compared to the corresponding 




424 



800 student ease above i ;i column three, mainly clue to tlio economies 
of 1 lie larger processor that would he required. But, it is :i«';iin the 
i nput/oulput volume an d the increased: supervision and clerical cost 
for secure input that builds the per -student figure. If w tool: this 
rase seriously, and, even if wo wove generous, 100,000 t rausact i ens 
per clay v.ould require 200 terminals lu generate SU0 transactions each 
per day, J;aeh of the 200 terminals would require an operator, which 
at a nominal 85,000 per year cad:, produces a clerical payroll alone 
of $1,000,000 per year. Two or three times that figure could occur 
if loading were not perfect, further, a completely dedicated real tine 
system, at a minimum cost of $1 Million or more per year, would be 
necessary. Add in the cost of ter.ninals, system prog raining and 
mai ntcMance, sunp] ies , user t raining, amortized instal lat ion charges , 
programming, etc., and it is not hard to envision a total system cost-* 
excluding testing, counsel ing and space-- in the $5-$K> million annual 
range. i Iso 81,500 annual student cost shown in Table 3 comes from 
an average of this range' spread over 5000 students. *Vo believe this 
figure to be low at current economic levels, l:\en though equipment 
costs arc rapidly dii/h nishing , personnel costs arc ever increasing 
(in current installations' of this type personnel costs approach 50* 
of total operating expenditures).^ 



[lata processing costs that total between $5 and $10 million 
annually arc not necessarily mules j rabic^-i f we have a large enough 
economic base against which to wort, as, say, the airliner dc. A few 
million spent on pin •injug u it 1 con t VO 1 SC 0,1 a Snal \ J )i the i aw* Ul gl'OS 
sales approaching a half billion to a billion a year. i>ut , we do not 
have that case vi th 5000 students. 



It nay be- argued that elementary education, and preparing teachers 
for it, is indeed a irul l i-bi 1 lien dollar operation, which is true. But 
the population is not easily consolidated to provide the volume necessary 



1C»A simple arithmetic extension of the figures above produces an estimated 
cost per transaction for the real-tine case of $0.50, which is $7.5 
million divided by the 15 million transactions per year provided by 
100,000 transactions per day times 150 academic days per year. This 
earlier transaction cost is not to be confused with the $1.00 per trans- 
action stated for airline reset val ions . due to the elimination of tele- 
phone line charges and the possibility of more rapid clerical handling 
of experienced students, as opposed to the usual airline customer’s 
reservation problems. Nevertheless , at least at present, real-time 
response and confirmation is r.oic expensive per transaction than batch 
operation with delayed response. 
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without s i mu J tu noons 1 y increasing the variety of PC’s which undoubtedly 
would arise without rigid standardisation of nationwide educational 
offerings for all, a very unlikely possibility. So we abandon our 
final illustrative example as not feasible on economic grounds alone. 

Some Remarks on Alternative System benefits. As a consequence of the 
previous nine-ease analysis, we have abandoned as unfeasible all the.! 
high PC examples of column three of Table 5. Moreover, we abandon also 
all those in the first row on the ground that, a toiv-student school, 
standing alone, is not a useful consideration for this project. We 
have remaining the four cases in the lower left hand section of Table 3, 
and of these we question the 5000 student- 1000 PC combination as highly 
doubtful, for reasons previously mentioned. We now turn momentarily 
to the throe remaining ease combinations. 

In the last two rows of column 1, we have two traditional forms 
of record keeping, which show some economics of scale, but which lack 
the desired flexibility of student choice evidenced by our bench mark 
ease, at the center of the table, It is our continuing argument that 
as student volume increases, t lie PC count must drop to produce a viable 
system. If we turn to student benefits, as well as total system 
benefits, we also, in practice, foresee that t her ideal ease is; probably 
o)ie in which the PC count (for a two year program) is between 100 and 
1000. We can find little benefit in increasing the PC count on *3 
formal record kerning basic fnv either student or total system if such 
an increase begins to consume over-increasing amount of the student, 
ad mi n i. strati vc, and teacher day. In other words, if the PC count is 
increased beyond a certain point, given a fixed number of students, 
our students and personnel will find themselves so involved in trans- 
action detail that the main purpose of the system, the very flexibility 
of choice and method that was desired, will be diminished or lost, 

Jt is difficult at this time to measure the direct benefits of 
more (or fewer) PC’s in a given installation, but it is clear that such 
a relationship exists, at least in the limiting conditions. Only 
operating experience can provide this final cost /benefit measure. It 
has been our purpose in this Division to set forth the limits within 
a feasible operation that can be maintained. It has also been our 
purpose here to foster some thinking about alternatives to the inclusion 
of more PC’s and therefore LA’s, into t lie formal information system. 

It is, we find, an illusion to believe that a computer system is help- 
ful, or economic, for a wide range of diagnoses of human progress withou 
some decentralisation and grouping of detail. This conclusion is bns d 
not upon technical infeasibility, but upon the necessity for cxccssiv 
transaction loads and planning detail which can undoubtedly be handled 
informally, more congenially, and more effectively on a person-to- 
person basis before a plan and its history of execution enter the 
formal system. 



Some Roc "nmendcd Pro- Implementation Activities. We strongly recommend 
that thcT i'ol lowing steps be undertaken before a final information system 
is implemented, and that; after implement at ion further adjustments of 
the typo suggested be made: 

1. Pedagogical leaders attempt to refine and cluster their area 
PC’s and I A 1 s as well as eliminate those which prove redundant, in- 
effective, or unacceptable to students at the earliest posable d:Uc*. 

What has been dune in the analysis of teacher presentations and their 
alternatives will not be lost; that PC- 1 A detail may be published and 
bound for departmental use by both teachers and students. Such group- 
ing anu elimination will not only simplify the information system's 
requirements, but also provide logically clustered sets of material 
which will lend some structure to an otherwise undifferentiated and 
therefore potentially chaotic choice menu. That is, the grouping and 
elimination effort can provide some hierarchy of importance and rele- 
vance to the materials and thereby aid the information system, the 
student, and the teacher at implementation time. 

2. Administrators and teachers should continually consider the 
trades possible between human and information-processing resources 
before requesting the non-human alternative. For example, an additional 
$20,000 spent on data process.! Jig to handle more transactions (resulting 
from more PC's and IA's) will buy one highly skilled tutor, or another 

fo rmo 3 tea ch or who way we 1 1 pro v i d o d * a gn os 1 5 c i n s ? ght , c . 1 1 ■ d e nt cl i re c t lor. , 
and motivation to more students than tho equivalent dollars spent on 
formal processing manipulations. Certainly in the extreme esses cited 
from Table 3 we are sure this is so; and the human trade may well be 
a better one at the intermediate levels also. Thus, a balanced human/ 
machine combination may turn out to he better than either taken to 
the extreme. We have no doubt of that. 



Some Tec hnical Kotos on Infoimtion Systcin Economics* Both computer 
processor and computer terminal costs are expected to drop by orders 
of magnitude within the next five years. For example, the cost of 
small computers had already dropped to one third of their former value 
over a three year period (1967-9), As this shift occurs, particularly 
in terminal design, special attention should be given to input trans- 
action cost reduction and security problems. To illustrate, it is 
likely that inexpensive terminals that will accept pre-pun died, pre- 
marked, or embossed cards will be widely available soon, since some 
arc now available. H Such units also permit some variable information 



H The predetermined input for fixed information is desirable to limit 
input errors, and has been widely tested in both industrial and hospital 
applications. Sec Pat amat ion, November 1969, p. 380, for a description 
of a system currently in use at Deaconess Hospital, Si. Louis. 



input as well ns the fixed pro-determined input in various combinations. 
Thus, student II) curds, PC- 11) cards, and counselor 11) cards may all be 
inserted in such a machine, with variable test results, or other variabl 
diagnostic data entered manually, yet briefly. Such equipment* alterna- 
tives can shift the feasibility of PC and student volume combinations, 
and may do so drastically in the next five years. Although such changes 
will not, we believe, drastically alter our nsin line of argument in 
this Division, they may provide the possibility to improve upon t lie 
present bench mark, or to reduce the per student cost of its operation, 
for example, Lt may be possible to share improved terminals both for 
computer assisted instruction in some areas with some forms of short 
range resource planning, an area we have left to manual means at this 
time. 



hould_ thc_ Conclusi ons of the Divi sjen Change if We Changed Ass omnt ions? 
Yes. The careful reader will note that the cost: figure estimated in 
Table 3 comes from the assumption that with more PC's offered over a 
two year period, a student must complete a fixed percentage of them-- 
not on absolute nuiijbor--to graduate. This assumption, winch we took 
to reflect current pedagogical think i ng--provides a direct relation 
between the number of PC's offered and the number of transactions that 
must be processed per unit time. This inevitable transaction rale, as 
well as the file interact. Lon speeds required to handle the fixed per- 
centage assumption, produces economic and user ini oasihi J ity as Die 
PC count increases. 

On the oilier hand, consider the following alternative assumption: 
a student must complete a fixed number of PC's over a two year period 
to graduate, say 20—regard loss of the number of PC's offered. Assume 
that the chosen PC's will again fill the two year period/ Ke now have 
ten PC's per year; or, as before, twenty transactions per year per 
student to process. Moreover, even though the transactions may be 
voluminous, e.g,, 100,000 per year for 5,000 students, the number of 
transactions per year is orders of magnitude less than in the fixed 
percentage case, e.g., 15 million per year for the 5000 student- 
10,000 PC case in Table 3. Student transaction volume is now virtually 
independent of PC count, and t lie time scale is completely changed, 

Thus, it is possible to handle more and more students and more 
and more offerings- -provjdcd the transaction volume is constrained by 
long PC time lengths, the variety to be handled still provides complex 
processing problems, e.g., 10,000 PC's still presents a much more 
difficult management job as opposed to 1,000 but the operation is 
buffered by time. 

It is entirely possible to plan for 50,000 students and 10,000 PC 
offerings, provided the number of transactions is held within reasonable 
limits, as with the fixed number assumption. Indeed, wo would gain 
great economies of scale in this alternative situation. (The physical 



setting corresponding to this cose is that of the Great University, 
with its man>* offerings and many students-- who still work out their 
educational regimen in modules of long time length, c.g t| the traditional 
five courses per term. Here we have great flexibility of choice, not_ in 
time, but in combination, or in space.) 

'Die whole problem is turned around by this alternative assumption. 
The per student data processing cost is reduced, and we devote our 
total budget to more students and the now more independent problem of 
management of a wide range of resources. Neither student, nor manager 
need know all the detail, because the choice list of, say, 10,000 PCs 
may be departmentalized, so one human advisor may know in detail what 
is in his group. The student will also specialize of necessity and 
direct his efforts in summary form, working through a hierarchy of 
choices to the ultimate detail. 



So, as one would expect, the operating results, and the corres- 
ponding system feasibilities differ widely as we shift our operating 
assumptions. Yet, ironically, the result of the fixed PC assumption-- 
seemingly so different from the result of the fixed PC percentage 
assurnpt ion- -is just another example of the same tiling. 



In both instances wc are concerned with the feasible variety and 
volume of transactions that can be handled in a given fixed period of 
time. For a given data processing collar we may have (J) fewer students 
and more student choices per unit time, or (2) more students and fewer 
student choices per unit time. (In the latter case, the students get 
their variety by making their fewer choices from a larger potential 
list, if it is available.) 



If wo choose more student choices per unit time, for a fixed 
data processing budget, wc must have fewer students, so the cost per 
student inevitab ly increases . 



The METKP philosophy implies the latter route, and the reader 
must realize the inevitable consequences of that decision at a given 
economic and technological status wliicl exists at a point in time. 

.The careful reader may also observe that the costing methods of 
Table 3 provide cost per student figures for all real-time alternatives 
(as opposed to batch) which are higher than might be estimated if the 
processing system were employed, or shared, for other than record- 
keeping purposes. This is a correct observation. 

The costs shown in Table 3 were allocated to the single use 
scheme of Figure 1, or its real-time equivalent, to discourage large 
PC menus under the fixed percentage assumption. Our conclusions still 
hold--cvcn though the costs for the real time, 10,000 PC cases be 
divided by three. 
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Wo have assumed batch, weekly processing for the bench nark case, 
and also cited the 5,000 student- -1000 I'C case (below in Table 3) as 
infeasible. Within the mxl few years, as noted before, changes in 
computer economics may shift our bench mark from batch to shared- 
terminal feasibility and show some economies of scale for mure students 
at the 3,000 VC level, under Table Vs (the Ml-.fiiP) assumptions. The 
proposed bench mark system of figure 1 is, however, flexible enough 
to make this transition with few modi fieations. And, we arc satis- 
fied that the hiyji-lH! alternatives will remain infeasible for at 
least a decade, based upon human constraints alone. 

The activities required for the implementation of the information 
system are outlined in figure 2< Interactions with other components of 
the Mli lliP program are implicit . 



Conclusion. In this Section, wo have sot forth an argument which 
follows a straight line, based upon an analysis of information system 
parameters and specifications as they affect system cost and performance, 
Our thesis is that system variety and volume interact strongly, usually 
more quickly than the average person appreciates, to create undcsircd 
system effects, or in extreme cases to produce system designs which 
are clearly not feasible on one or more grounds. U'e proposed, a feasible 
bench mark case, then described variations, both feasible and unfeasible, 
that could be taken from it. In this way we concluded that our pro- 
posed ben^h mark case was, with, minor modi final ions, a system which 
provided a reasonable improvement over present methods of educational 
record-keeping, bearing in mind the philosophy of the; MfTbl- 1 proposal. 
Detailed cost/benefit adjustments in that system were, of necessity, 
left to the guides to be gained from later operating experience. 
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AI'lMiNDlX A- -POSSIBJJi SPECIAL Ulil'OUTS 



1. 


Names and addresses of all students for mailings. 


2. 


Geogrnph teal analysis . 


3. 


Profile of entrance exams in summary or by breaks. 


4, 


Analysis of accumulated student hours in the system. 


5. 


Analysis of failures and drops for each student. 


0 . 


Analysis of student population by major and sub-major. 


7. 


Analysis of elapsed time in system vs. sex. 


8. 


Conditional analysis of profile scores by sex. 


9. 


Distribution of major areas and sub-areas by sex. 


10. 


Distribution of PC's and IA's by sex. 


11. 


Analysis of elapsed time in system by home address (town). 


12. 


Analysis of resources consumed per student by area. 


13. 


Analysis of student load per time period. 


14. 


Analysis of student withdrawals from system by area. 


15. 


Analysis of student withdrawals vs. PC's completed and failed 


16. 


Percent self-study IA's taken by area. 


17. 


Distribution of IA duration selected by area (not self-study) 


18. 


Current PC vs. IA catalogue. 


19. 


Profile scores vs, elective IA type selected. 


20 


Utilization of maximum special IA size. 


21. 


Historical trend of IA type selected by area. 


22. 


Historical trend of area transfers. 


23. 


Analysis of PC's assigned but dropped by area change. 
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24. 


Analysis of reliability of student demand projection, 


25. 


Analysis of student demand by semester month. 


26. 


Analysis of resource demand by semester month. 


27. 


Analysis of sub-area specialization vs. major area. 


28. 


Analysis of illegal transactions entered into system by source. 


29. 


Analysis of area selected vs. home location, 


30. 


Count: of popularity of PC's and associated IA's. 


31. 


Analysis of failures and drops by major. 


32. 


Analysis of pass by major, 


33. 


Analysis of failures and drops by diagnostic code. 


34. 


Analysis of resource utilization survey, 


35. 


Analysis of resource utilization vs, IA's or PC's. 


36. 


Analysis of PC and IA offerings during term. 


37. 


Frequency of PC and IA's waived due to pretest. 


38. 


Analysis of PC failures, repeats, drops, vs. resources used. 


39. 


Analysis of average elapsed tine to pass each PC. 


40. 


Survey analysis of elapsed time in system by area, 


41. 


Analysis of assigned vs. completed PC's. 


42. 


Analysis of estimated maximum student time to completion by student 


43. 


Analysis of evaluation type by area. 


44. 


Analysis of failure by evaluation type. 


45. 


Analysis of elective PC's chosen by specialist area. 


46. 


Analysis of average IA's taken to pass each PC. 


47. 


Filtering profile scores vs. time to completion. 



o 

ERIC 


436 



48. Analysis of human resources vs. student ('roup size. 

49. Equivalent number of credit points completed to date by student. 

50. Number of pretests taken and passed. 
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TESTING AND GUIDANCE OPERATIONS 



No better priori' could be found for n n introduction to this sec- 
tion than Sbernan Kent's St rote; flic Intelli g ence , a work directed to 
secret agents and Llieir managers . * 

Tliis somcvjhat obscure, but important book, contains a clear ex- 
position in non-tcc.hnical terms of the steps intelligence organiza- 
tions use to collect, process and evaluate information. 

Briefly put, the most striking result of this study is that in- 
formation systems fail, not because insufficient amounts of accurate 
information are available but because patterns of importance may be 
misinterpreted, may not be recognized until too late, or if recog- 
nized correctly, may not be. believed. From such failures we have a 
Pearl Harbor, a Bay of Figs, a Pueblo Incident. 

In an attempt to avoid such blunders, the intelligence services 
of the world have developed an almost common form of organization. 
Data coming from the field passes first through specialized "desks 11 
where local conditions are summarized, and where the ultimate detail 
of a local situation is analyzed . Thus, there is a "Cuban Desk," a 
"Laotian Desk" etc. But the local picture is not the whole story; 

An isolated fragment of information, which might not seen important 
at the specialized, local level, may when combined with other frag- 
ments collected across the board point to a pattern of .strategic im- 
portance. So, the intelligence services also employ specialists v/ho 
seek to integrate patterns, not locally, but internationally. We 
have the aircraft technology expert, the expert in gold smuggling, 
the individual who monitors movements of political figures from one 
scene to another, etc. and coordinating the whole wc have generalists 
who luok for larger patterns in this vertical and horizontal input. 
Lvcn with this form of organization, which has proved to be better 
than most others, some of the fragments that could form a meaningful 
pattern will be lost, or misinterpreted. That is a fact of the in- 
telligence business, an inevitable consequence of the variety and 



*S . Kent, Strategic Intelligence for American World Pol icy . 
Princeton. University Press, Princeton, N.J., 1 9 A 9 . A Yale histori- 
an, Professor Kent v:as in charge of OSS operations in southern 
Franco and North Africa during World War II. His book, written on 
a Guggenheim fellowship, discusses the organization, operation, and 
management of intelligence services. The observations made have 
general value; the same information-handling and evaluation pro- 
blems plague the Kiras nans , Standard Oil of New Jersey, and the C/A 
as well as the MLIIF proposals. 
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volume of information transactions which must be, or night be, evalu- 
ated. The hope is to reduce such errors to a minimum by careful de- 
signs . 

Although tliis diversion into the James Bond world may appear ir- 
relevant to the subject at hand, uhat has been learned about intelli- 
gence system organisation is precisely applicable to the METEP Test- 
ing and Guidance Operations and its supporting Information system. 
That is because the METEP Testing and Guidance functions provide 
strategic intelligence which guides the total educational effort, in- 
cluding diagnosis of student difficulties, guidance for specific pe- 
dogogical development and teacher aid, and overall planning for re- 
sources, methods, and schedules. 



Testi ng and Guidance; The M ETEP Intelli gence Service . Like an in- 
ternational intelligence system in miniature, the METEP information 
operations involve many areas of specialization, In which detailed 
data must be known. Wo have, in fact, a "Mathematics Desk," a "Lan- 
guage Arts Desk," etc., where the intimate detail of those special- 
ties and their operation will be best known. 

For example, for detailed counseling within the matnematics 
area, it is clearly desirable to tall; to the mathematics expert. 

On the other hand, we also have another form of specialist who 
looks across the disciplines: the expert in testing method, the 

counselor who follows an individual student rather than a subject 
area, the resource scheduler who must avoid conflicts in commonly 
used facilities and between assignments of students to activities. 

And, finally, we have the generalized administrative functions 
of policy development, evaluation of overall plans, and the antici- 
pation of future needs. 

In addition, as is the case with most intelligence systems, 
the METEP Testing and Guidance functions confront a range of data 
input types from the "hard" results that may be obtained say, in the 
Mathematics Area, from pencil and paper tests organized by item to 
evaluate detailed segmented objectives,* to the less structured eva- 



*Vtilliafn P. Gorth and Lawrence Wight man, "CAMS The hew Look in 
Classroom Testing," Trend , Spring, 1969, pp. 56-7. CAM is an abbre- 
viation for "Comprehensive Achievement Monitoring" a technique which 
tests in detail for educational objectives related to achievement, 
attitudes, or perceptions. 
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luation of human behavior, ns in the Language Arts. And, in the hier 
nrchy of testing and counseling efforts, we have various forms of pre- 
tests, current tests of detail (for student self-help) , and post-tests 

Since the information gathered by the testing and counseling pro- 
cess is of both immediate and historical interest, the inputs and out- 
puts needed by the Testing and Guidance operations directly influence 
the Management Information System and vice ver sa . 

For example, as noted previously, when the number of testing seg- 
ments becomes larger for a given educational activity, rhe transac- 
tion load placed upon the system’s users and the information system 
itself quickly increases, and so it is not feasible to maintain ex- 
cessively detailed records on a continuing bafis for all students or 
activities without eventually degrading the entire intelligence ef- 
fort, or even the objective of the MET HP proposal, regardless of cost 
considerations . If, in addition, the cost of record-keeping, test- 
ing, and counseling is introduced, excessive segmentation of the test- 
ing, counseling, and achievcment-moni toring effort soon drives data 
processing costs beyond reasonable bounds. Where such detail is need- 
ed for research purposes, devices such as statistical sampling have 
been employed successfully to adjust costs and benefits. Rut for 
everyday operation, the design of the intelligence system must be ad- 
justed to provide what realistically can be obtained* 



The Jtec e n t r all Cc XCAL* ng and Guida nce. Operat ion. To 
hold down transaction rates while at the same time maintaining the 
desired vertical and horizontal intelligence levels, we propose a 
combination of both decentralized and centralized counseling and 
testing. In some areas such as Language Arts, the more decentra- 
lized form of effort will predominate, whereas in others, such as 
Mathematics, a more centralized approach will be natural. We see no 
reason why such flexibility of organization is not desirable, par- 
ticularly when the data input characteristics of such area^ differ 
so widely. 

To illustrate the form of organization proposed, vc now cite 
two cases: (1) Language Arts, and (2) Mathematics * In each case, 

we look at the Counseling and Testing efforts that can be decentra- 
lized versus those which may he centralized beneficially. In strik- 
ing this comparison, it should be noted that the terms "decentralize" 
and "centralize" do not, in our present context, mean necessarily 



*Sce Corth and Kighlman, op. cH. 







a physical dispersal or congregation of individuals 
refer instead to the manner in which information is 
case, we will comment upon the Counseling, Testing, 
System variations t he alternate approaches suggest. 



or efforts, but 
handled. In each 
and Information 



Langu age Arts: Ca se T . Here is a description of the feasibility 

study results from Language Arts, taken from the notes of that Area's 
supervisor. The routine noted lias been applied successfully to 120 
students during Fall, 1969, in a highly decentralized effort. 

The Performance Criteria may be attempted in any order, 
and may be spaced in any way the candidate wishes. If the 
present time arrangement continues, lectures and discus- 
sions in the classroom will be available only during a 
specified five week period, but all other instructional 
alternatives will be available through out the semester. 

The procedures are: 

1. List of all Language Arts performance criteria 
is handed out to each candidate. 

2. List of suggested md available i nstt uctionaj 
alternatives is handed cut to each candidate. 

3. Candidate nay attempt the PC whenever lie feels 
ready. 

PC candidate completes a questionnaire to be 
handed in with each PC, indicating which, if 
any, instructional alternatives have been used. 

5. PC is rated by one of a group of pre-trained 
raters. Rating scales are available for each 
PC. 

6. Pass, no-pass charts arc kept for each PC in- 
dicating date(s) of each attempt, and infor- 
mation on whether or not candidate has passed. 

7. A master chart is kept listing each PC and 
each student. The chart is filled in only 
when student has successfully passed the PC. 

Counseling procedures: 

1, A general information sheet is handed out to 
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each student. 



2. Discussion hours open to all candidates will he 
held at various litres during the week. Raters 
will preside over those discussions. 

3. bulletins will be issued regularly, reminding 
candidates oi the PC’s they have yet to com- 
plete. 

4. Part of the rating process will include indi- 
vidual comments made by raters on each candi- 
date's PC. 

1) Raters V7.U 1 attend a workshop in Lan- 
guage Arts so that their training and 
information will be consistent. 

2) Questionnaires include evaluative in- 
formation by the candidate, concerning 
the value of the PC’s and IA's. These 
questionnaires will be analysed by com- 
puters . 

Although the f o i tii of human behavior moot luting described above 
lends itself most easily to decentralized testing and evaluation 
using human raters, and although much, on-the-spot counseling can 
take place at the time of evaluation on an individual basis, some 
centralized extensions of this scheme are also envisioned bv the 
Language Arts supervisor. Tor example, alio sees eventual use of 
video tape facilities in centralized testing and evaluation, if only 
on a sample, basis to aid in setting standards of performance which 
may serve as a model for later candidates as veil as standardiza- 
tion tools for rater consistency tests. Further, although counsel- 
ing may still be highly individualized, this supervisor sees some 
merit in having a Language Arts counselor physically located nt a 
central location for physical convenience of students and staff. 

By and large, however, testing in this area will continue to be de- 
centralized because of its nature. 

Note also that the decentralized Pass* Fail record keeping, the 
flexibility of back-up materials for student self-study, and tiro 
five-week plan for blocking out human resource allocation, greatly 
simplifies the potential information processing inputs from this 
area. For example, h. to it is possible to batch for historical 
purposes a number of completed PC's together with a few simple de- 
tails on cacti. The main function of an automated information sys- 
tem for this Area v;ould 1>o to alleviate clerical workloads, such as 
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preparation of typed status reports for students - and even such apparent- 
ly trivial* yet burdensome detail as tne preparation of mailing lists 
on envelopes for student information distribution. In addition, the 
combination of cuiuaary PC detail in batched form nay be combined with 
other student-file data to provide research data for Language Arts use, 
e.gt, entering test profiles versus Language Arts success. 

Mathematics ? Case 11 : Turn now to a different scene in which detailed 

segmentation, item testing, and detailed PC/1A combinations can hr-, 
generated with ease. Here we have "hard facts" - the candidate either 
knows how to obtain the correct answer or he does not. 

Note, however, in the description of feasibility study experience 
below, that the supervisor of this area found it necessary to group 
instructional alternatives and highly segmented PC’s into "hooks" of 
detail which could be used to aid the student and the Mathematics 
staff, but which need not necessarily clutter the permanent information 
processing system with transactions. Note also that this counseling 
and testing activity is potentially one which could largely be 
centralized, with a partial decentralized counseling effort specialized 
to the remedial needs uncovered through the centralized test procedure. 
Also, we have here the ideal, subject for detailed test item development 
and evaluation, following the Comprehensive Achievement Monitoring 
(CAM) technique previously cited. The number of students involved in 
this area’s feasibility test was 9^ 

Here are the Mathematics Area’s procedures, as reported by the 
Area supervisor: 

The class mode of instructional alternative for each 
performance criteria module would be available on a 
regularly scheduled (every fourth week) basis, while 
the other instructional alternatives would be available 
at any lime in the mathematics learning center laboratory 
A full time professional and at least one graduate 
student with expertise in math education would always be 
available at the mathematics learning center laboratory. 

The testing program for the mathematics component of METEP is 
partitioned into three phases, A. The pre-test phase on each performance 
criteria nodule. B, The self-evaluation phase on each performance 
criteria nodule. C. The post-test phase on each performance criteria 
nodule . 



A* Students wishing to pretest on any performance criteria module 
could do so in one of two ways: 1) by taking a regularly 

scheduled pre-test as one of a group prior to the corresponding 
class mode of instructional alternative for the performance 
criteria mo lulu In question. 2) By reporting to the mathematics 
learning center laboratory to take a pre-test on an individual 
basis at the convenience of the student. 
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B. After some exposure to one or more of the instructional 
alternatives available to the student, lie may scl C-cvoluale 
his progress in the performance criteria module by reporting 
to the mathematics learning center laboratory to take a 
self-evaluation test: on L he performance criteria module, 
complete with detailed solutions to each problem or task. 

These self-evaluation tests can also serve Jn affect as an 
additional instructional alternative. 

C. Once a student feels confident enough to take and pass the 
post- test on the performance criteria module, lie nay take 

the post-test in one of two way s: 1) by taking the regularly 

scheduled post-test as given subsequent to the completion 
of the scheduled class mode of instructional alternative for 
the PC module in question. 2) Ly reporting to the 
mathematics learning center laboratory to take the post- test 
on an individual basis at the convenience of the student. 

The above outline would apply to all of the mathematics content 
performance criteria modules and many of the mathematics pedagogy 
modules. Those pedagogy modules which require actual demonstration of 
teaching ability tc children would only be tested c>n a regularly 
scheduled (every fourth week) basis. The mathematics "expressive 
experience" modules have no testing program as such. 

Little need be added to flint description to indicate the 
difference in testing and counseling needs between Mathematics and 
Language Arts. It is also interesting to note here that the main 
input to the Management Information System would be pre-test and post- 
test results which have been proposed on a periodic basis of four 
weeks, staggered in one week intervals. Although the problem of test 
security becomes important in this area, various devices, such as the 
random generation of test items, possibly by a computer from a 
stratified list of possibilities, can be used to overcome any statistical 
difficulties . 

A Counsel o r’s Opinion: Case 111: Turning from the special areas to the 

counseling specialist, it is interesting to see that here, too, the idea 
of both decent ralized and centralized efforts emerges. 

Our counseling export reports as follows. His notes have been 
edited for brevity. 

It is necessary to have a counseling function on three discrete 
levels. 

The. first is informational. The function here is to aid the 
student in the selection and implementation of the PC’s within a given 
area. Such counseling Would be a part of the pedagogical area’s 
effort, not centralized. The counselor at this level will also serve 
to provide sources for referral for the instructor ns well as for the 
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student. In other words, problems Hint are beyond the scope of the 
individual teacher, or beyond the scope of the student or his counselor 
will be referred to n counseling function outside, of each individual 
pedagogical area. 

Tli e second discrete counseling function is the provision of resource 
persons for the faculty member who is involved in working with students 
on their PCs and lAs, Wliat is meant here is that where a faculty member 
feels bogged down in his relationship v?i th stude nts, or where he feels 
that his PCs and lAs are beginning to run him, counseling may help that 
faculty member to see new ways of attacking PCs and lAs that are both 
more relevant to him as a teacher and more relevant to the interaction 
between teacher and student. 

The third level of counseling function is to see students on a 
long term basis, to know them as individuals - apart from their area 
of specialization and Hie PC- I A detail. This form of counseling 
requires a much broader perspective of the METtP program generally, and 
of individual emotional and vocational objectives in particular than 
will be required at the other levels. 

The latter two functions, as described above, fall into a centralized 
pattern. In addition to the specific day-to-day counseling suggested 
above, another by-product of the centralized effort is t lie evaluation 
of testing methods, their validation through counseling feedback, and 
the suggestion of test items, both unobtrusive and obstiusive, which 
may aid students and faculty in their work. 

The Management Information System provides the counselors at all 
levels a variety of working tools, for instance: J) student records 
updated periodically, 9 ) current listings of PC/lA availability, 3) 
complete cross-reference of data in student files for research studies, 

4) evaluations of PC/lA popularity, satisfaction, and demand, 5) 
evaluations of material retention by means of historical records of 
student performance on detailed test results, duplicated PC’s, and 
similar test modules, and 6) assistance in the day-to-day details of 
information handling, such as generation of lists of delinquent 
students, drops, PC changes, over and under-utilized resources, and 
anticipated schedule changes. Similarly, the counseling effort 
provides input to the Information. System, either through the student’s 
signup for a PC group and his completion of that segment, rt directly 
through counselor input to the system in the form of antic ated TC 
demand, and similar detail. 

The Mechanics of Testing and G uidan ce. The three cases above which 
provide a sample of PC/lA handling experience during the feasibility 
study lead vis to believe that a combination of decentralized and 
centralized testing and counseling will he desirable, economic, and 
satisfying to both students and staff. 

The decentralized testing and guidance reduces the transaction rate 
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against the information system, thereby greatly reducing its design 
requirements and costs. Moreover, the same transaction rate reduction 
eases the centralized tasting load and its associated problems of 
security, paper generation, and student traffic. The benefits accrue 
to the counseling effort: decentralized counseling provides the area 
detail; centralized counseling provides the student continuity of 
association, width of vision, and summary research data on the program 
as a whole. But, the formal counseling transaction rate is reduced by 
the dual approach. 

The details of a decentralized testing and guidance operation may be 
xeft to each area's supervisor. In general, such efforts will be on a 
personal basis, and the tests given on a decentralized basis will be 
student self-tests, the results of which need not be universally 
recorded. The decentralized counseling and testing efforts w:’ll be 
coordinated with the centralized efforts, of course, by virtue of the 
common records provided by the Management Information System on students, 
PC/IA offerings, and summarized resource allocation. 

At the centralized effort, the METEP proposal suggests a definite 
and permanent set of individuals who v?ill provide both clerical 
assistance and at a higher level continuity of guidance during the 
student’s period in the system. In addition to this permanent general 
staff, the centralized physical location will also provide space for 
decentralized counselors who wish for physical reasons io meet 
periodically at a given place and time with students and other staff 
Timbers . 



The detailed staffing, space and fixture budget for the centralized 
Testing and Guidance Center associated with the METlT proposal may be 
found in the Economic Feasibility section of this report. 

The Corn of test administration and data input into the Management 
Information System arising from either decent ralized or centralized 
sources has been planned for optically read forms. The same equipment 
may be used for test scoring and other forms of transaction input. A 
typical form, such as Optical .Scanning Corporations Utility DS 1109-4, 
or its equivalent, may be specialized to handle both initiations and 
completions of FC’s, and other transactions which may enter the system 
Iron students or counselors. The same form may be used for optical test 
grading in those Instances where such an approach is pedagogically 
desirable. We have not designed detailed optical forms at this time, 
since the technology of input devices and their econcmies is shifting 
rapidly. Alternate input methods may be considered more desirable than 
8 1/2 x 11 inch sheets at implementation time, although the general 
principle of key-board avoidance is to be maintained. 

The generation and administration of tests on a centralized basis, 
either for pre-test or post- test presents some mechanical problems. As 
the volume of testing increases , and in particular ns (he variety of 
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testing employed at the centralized location par unit time increases, 
the problem of generating test schedules which are uniformly difficult 
as well ns secure passes beyond human productive ability, and requires 
the use of mechanized effort. 

Although we have not estimated nor planned for the computer 
generation of individual test schedules in addition to automated grading 
and item analysis, we anticipate that such schemes may bo needed if the 
test transaction rate at the centralized center cannot be held to 
modest propositions. This is another argument for the decentralization 
of as much Counseling and Testing as possible in this system. Tlie 
arguments of the Information System Section of this Report apply with 
equal vigor to the Counseling and Testing schemes proposed here. 

MKT HP T est! and G i nUla nee Prediction and Cent r pX • Most intelligence 
systems provide information of three types: 1) facts which change 

slowly, the descriptive element; 2) new facts which update the old, 
the reportorial cl eme nt , and 3) generation of predictive results, the 
speculative element. The proposed combination Testing, Guidance ami 
the Management Information System provides each of these intelligence 
outputs. The student record file contains not only the history of 
student progress, but also the lccord of facts which will for a given 
student change slowly. The results of Testing and Guidance provide 
the update, or reportorial function. From the combination of these two, 
analyses of classes of students. FC/1A .selection and success patterns, 
and counseling and testing methods nay be made to predict the success 
of future students entering the system. The same predictive results 
may also be used to design improved PC/IA detail and groupings in t lie 
continued improvement of the METKP plan. This, of course, is the purpose 
of the management system which rests upon the data available from Lite 
Counseling-Testing-Information Systems package. 



Imp lement a Uq?\. Figure 1 illustrates the steps necessary in imple- 
menting the testing ami guidance subsystem. The evaluation, analysis, 
and updating step implies the cyclic nature of the listed activities. 
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ECONOMIC FEASIBILITY 



Introduction 



The economic feasibility of a proposed purchase by a family is 
usually determined by answerings 

1, Is this the best use of our money? 

2, How much will it cost? 

3, Can we afford it? 

4, Do we have sufficient financial controls to insure the 
expenditure of funds according to a planned program for 
payment of the purchase? 

The family’s answer to the first question is usually based on subjec- 
tive and emotional data. The cost is usually determined by "shopping 
around" for the best buy and the ability to purchase is based on cur- 
rent and/or anticipated resources. The control of resources for pay- 
ing for the purchase normally consist of the family budget and fiscal 
decision processes used by the family member who is responsible for 
the expenditure of family income. 

Many aspects of the four questions overlap, therefore, the 
feasibility of the purchase is not normally determined by one paas 
through the list of questions. For example* an increase in the 
financial commitment necessary for purchase may negatively ef f ect 
the desire (need) of the purchase or if the desire is strong, an 
overly optimistic projection of anticipated income may occur to make 
the purchase appear feasible. 

The determination of the economic feasibility of the family 
purchase is an iterative process. The complexity of the process in- 
creases with the cost and time commitment associated with the pur- 
chase. 

The economic feasibility of the METEP project is determined 
by using a similar but more complex approach . 

n Is this the best use of our money?" The appropriateness of 
the expenditure of funds for implementing and operating this exper- 
imental program can be determined by examining: 

1, the need for a new training program for elementary 
teachers, 
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2, the objectives of the program, and 

3. the pedagogical feasibility of. the instructional design* 

These items, the rationale ? objectives, and pedagogical feasi- 
bility, are discussed in sections 1 and II, An affirmative conclu- 
sion to the appropriateness of this experiment a] program may bo. 
derived from examining these sections of Die report# 

"How much will i t cost?" A five-year cost projection indicates 
that the operational cost of a program nerving 800 students will be 
approximately $1,575,500,00 per year# This would be an annual per 
student cost of $1,967,00, The five-year projection of the program 
cost is subsequently presented and discussed, 

n Can we afford it?" The US OK provides financial support for 
the development and implementation of exemplary educational pro- 
jects. The funds which have already been granted for die develop- 
ment of the Model Elementary Teacher Education Programs are exam*' 
pies, The US01J has also indicated a willingness to aid in the im- 
plementation and initial operation of seme of these projects which 
are shown to re feasible. However, it is not the responsibility 
of the UvSOE to provide the funds necessary for the continuing oper- 
ation of the program. This is a re^ponsibil i.ty of the institution 
and its sponsoring organisations , e.g, the School of Education 
the University of Massachusetts, and the State of Massachusetts, 

The intention of the institution to provide necessary funds for the 
continuation of the program is therefore a criteria for determining 
economic feasibility. The Federal government cannot afford to pro- 
vide funds for "permanent" programs where chare is little or no 
intention o£ continuing the program past the federally funded period 

Although the intention of the school and state to continue the 
program may be explicit, it is also necessary to demonstrate their 
ability to do so, This is a second criterion for determining eco- 
nomic feasibility. One way in which this criterion may be satis- 
fied is to demonstrate that the student cost per year in the pro- 
posed program for training elementary teachers does not appreciably 
exceed the current cost allocations. The ability to facilitate the 
effective use of funds is a third criterion in determining "can we 
afford it*" An institution cannot afford to waste "education dol- 
lars . 11 



Cost-effectiveness analysis provides administrators (decision- 
makers) with data which relate the cost and effectiveness of alter- 
native courses ox action. 



S « (Juacle , Cost -if fc el mj ices _ An_ J n t rod ucti on an d Ovary low . 

Santa Monica, Calif.: The Hand Corn., 1965, p,2. 
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The alternative courses of action my be implicit, For example, 
cost and student achievement may be related in analyzing the in- 
structional alternatives associated V7ith a performance criterion. 

The resulting data, complemented with other information about the 
students and program, may be used in scheduling, deleting or alter-* 
iwg the availability of instructional alternatives. 

The criterion of program ccst-ef f ectiveness can be satisfied by 
presenting plans for implementing techniques for performing cost 
analyses and stating how cost-effectiveness data will be used in 
evaluating and refining the proposed program. 

The above three criteria are vised in determining "can we afford 
it." They address the question of the feasibility of the investment 
of Federal funds, the ability of the school to continue the program 
after Federal funding is phased out, and the ability of the school 
to effectively allocate funds. Information provided in subsequent 
parts of this section will indicate that the proposed program suc- 
cessfully satisfies these criteria. 

"Do we have sufficient financial controls to insure the expend- 
iture of funds according to a planned program for payment of the 
purchase?" The fiscal subsystems of the project are designed to 
provide the necessary budgeting and accounting procedures to insure 
the efficient fiscal operation of the program. These subsystems are 
described later in this section. 
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PLANNING-PROGRAMMING BUDGET DESIGN 



Introduction 



The METEP budget Is .1 financial reflection of tlie project's 
objectives * It is a dollar statement of values and priorities, in- 
dicat ing bolh direction and speed of movement toward goals. The 
work of each METEP member and the development of each subsystem or 
program are directly affected by th budget and the budgeting pro- 
cess. Every member of the METEP team should understand and be ap- 
propriately concerned with the development of the METEP budget. 

In order for METEP to wisely and effectively utilise its re- 
sources, budget making must be based on: a) a clear statement of 
objectives; b) procedures for generating programs of teaching, re- 
pricing, comparing, evaluating and assigning priorities to such 
activities. The METEP project's budgeting activity will be success- 
ful only to the degree that the responsibilities , procedures and 
sources of authority in the budgeting process are understood and used. 
Conversely, to the degree that the budgeting process is misunderstood , 
and/or ignored, the METEP budgeting activity will be unsuccessful: 
when budgeting is increasingly unsuccessful, the METEP project will 
be in danger of finding its objectives and programs determined by the 
politics and mechanism of dollar allocations rather than be education- 
al philosophy. 

Planning-programming budgeting is a technique which, if used 
effectively, will escape mechanistic allocations. It is a technique 
which emphasizes optimum allocation of resource among competing ends 
according to the ’objectives’ of the organization. It lays stress 
on controlling the outputs of the project by managing the effective 
use of inputs. Analysis of outputs of the project by managing the 
effective use of inputs. Analysis of outputs and input usage in 
the PPB system is extremely important. In the profit-seeking or- 
ganization, problems of measuring success or failure are facili- 
tated by income and balance sheet statements. These tools have 
little value in measuring the results of projects like METEP. Suc- 
cess or failure in METEP is not measured explicitly in dollars, but 
rather by the degree to which structured goals are achieved. Anal- 
ysis related to achievement is aided by a program-oriented budget 
because each program's output can be analyzed in relation to its 
budgeted inputs. For these reasons the METEP budgeting process 
will utilize the plonning-programming-budget Ing technique. 

What Is A P rogram? Essential to planning-programming-budgeting is 
the concept of a program. There exists no clear-cut definition of 
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a "program 11 and there are ambiguities and inconsistencies at ill lev- 
els of usage. However , the concept has special significance to the 
understanding of METEP T s planning- programming budget. This budget 
has as its foundation a number of component urograms, which, in total, 
represent the entire METEP effort. 



Defin ition, A program is here defined as an entity consisting of 
various components designed to achieve specified objectives with var- 
iable time constraints by utilizing and transforming identifiable 
resources into end products. These end products will result from 
the utilization of complementary programs within a specified scope 
of activity. These activities, which will be carried on by the pro- 
gram components, exist over an uncertain time period. Some activi- 
ties are short-lived, while others will continue for the life of 
the project. 

The components of METEP also satisfy the above definition. 

Each of these components represents an activity or function which 
has its own specific objectives, scope of activity and distinguish- 
able outputs. These elements can be classified under Ivto general 
headings: adn inistrative subsystems and education programs. The 

education progi ams produce the end products of METEP, the adminis- 
trative subsystems produce only supportive, intermediate products 
which are used and shared by all education programs. These two gen- 
eral categories are the initial building blocks of the METEP plan- 
ning-prograuiming-budget system. 
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trative Subsystem. 


i. 


Management 


2. 


Information System 


3. 


Evaluation and Research 


4. 


Testing and Guidance 


Education Programs, 



i. 


Human Relations 


4. 


Pre-school 


2. 


Behavioral 


5. 


Science 


3. 


Language Arts 


6. 


Social Studies 
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7. 


Mathematics 


12. 


Technology 


8. 


Urban Education 


13. 


Evaluation 


9. 


Aesthetics 


l't. 


Supervision 


10. 


Inscivice 


13. 


Foreign Language 


11. 


Media 


16. 


METEP Orientation 



In themselves none of these programs or subsystems can attain 
the total specified objectives of the MET BP project. Each element 
does influence the credibility and effectiveness of the project; 
therefore each plays an integral role in the success of the total 
project effort. Each is in competition with the other elements for 
a ’ailable scarce resources within the project. These programs and 
subsystems are critical success factors of MET BP , and are incorpo- 
rated in the METEP planning- programming-budget . 



W hat Is A Planning-Pro gr amming Budg et (PPB)? There is no standard 
definition of a PP3. For this reason, a narrative approach is used 
to expand understanding of a PPB as it will be viewed in METEP, 

The planning-programming budget differs from the line-item control 
budget in which detailed classif icat ion of objects of expenditure 
(inputs) and control of these items are emphasized. The conceptual- 
ly newer PPB places emphasis on che end objectives (outputs) and the 
control of costs needed to achieve these objectives. PPB uses budg- 
etary techniques to emphasize and facilitate explicit consideration 
of pursuing policy objectives in terms of their economic costs (op- 
portunity costs) and the total dollar costs, both in the present and 
in the future. 

PPB is used as a multi-purpose approach to overall budget con- 
trol. It focuses on the budget decision-making process, particular- 
ly on the problems relating to resource control, allocation and use. 
It is intended to bring about a more efficient and effective allo- 
cation of resources (staff, space, equipment, etc.). This is a- 
chieved through a careful appraisal of the program* s needs in light 
of the program’s objectives and outputs, 

PPB pro ir a comparisons between the resource requirements of 

competing programs. This is possible because resource alternatives 
and programs are expressed in a common denominator: the dollar. 

Program budgeting facilitates the utilization of both "cost benefit" 
and "cost effectiveness" analysis. PPB uses cost benefit analysis 
to determine the potential and the actual contributions programs 
make to the projects’ end objectives in terms of output and cost. 
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On tiie other hand, PPB uses "cost effectiveness analysis" to deter- 
mine if an effective and efficient usage of inputs is being attained 
by programs in the production or distribution of outputs. 

On the basis of the appraised needs, the comparison of alter- 
natives, and the evaluation of contribution to the end objectives, 
METEP ’s central management can strategically plan, program, or coor- 
dinate the project’s present and future financial needs. The charac- 
teristics of a PPB system suggest that it is a better management 
tool than the conventional budget. 

Operated correctly a PPB system should provide METEP with bet- 
ter program and subsystem planning, management, and control than the 
conventional procedures. 



A Compari so n of Co nventional Accoun ting a nd PPB Accounting . A1 1 
educational accounting systems are primarily concerned with the le- 
gal and fiduciary responsibilities which result from the receipt 
and expenditure of state, federal, ard other funds. The conven- 
tional accounting functions within an educational system are those 
that concern themselves with keeping detailed financial records. 

The following are typical activities: 

1) Recording source and amounts of all funds, 

2) Controlling the receipt and expenditures of these funds, 

3) Aggregating total expenditures by line-item (object). 

4) Aggregating total expenditures by activity (purpose). 

5) Projecting budgets for two years at most, 

With the introduction of PPB accounting system to the METEP 
project, the above functions of accounting are greatly expanded. 

The following functions arc added to the finance officer’s scope 
of accounting-budgeting functions, 

1) Assist in the determination of the general and specific 
objectives of the METEP project. 

2) Design, manage, and implement financial procedures 
and forms which will help to achieve the end objec- 
tives, 

3) Develop new categories of object and activity ac- 
counts for all programs in the METEP project. 



4) Assist in the long-range projection of resource requirements 
for each program, 

5) Assist in the programming of the acquisition of these re- 
sources , 

0) Assist in the preparation of a 1 ; PB on the basis of the 
above projections and programming. 

7) Assist in the development of criteria needed for "he 
evaluation of program performance and progress. 

8) Develop financial contingency plans in case of funding 
changes , 

9) Assist in the determination of the long-run "economic costs 11 
and dollar costs of alternative within a program as well 

as the cost of each program, 

10) Assist in the measurement and evaluation of the contribution 
of various alternatives and programs to METEP's end 
objectives . 

11) Communicate the above information to decision-makers. 

12) Coordinate METEP's financial system with the university's 
and school's financial systems. 

M ETEP's Inte r nal Budget Cyc le, The budget cycle for the METEP project 
contains all essential stages and procedures necessary to the 
employment of a PPB system. It provides not only for the development 
of a project: PPB, but also for the development of programs of 
subsystem PPBs . 

The budget cycle is designed to eliminate shortcomings which 
have been noted in other instances where the PPB system has been 
used. Specifically, the design hopes to prevent the following de- 
ficiencies : 

1) Misunderstood or undefined program objectives, 

2) Insufficient time periods for program review and decision 
making, 

3) Inadequate Investigation of program accomplishments or 
lack of accomplishments. 



4) Over emphasis of budget analysis related to expansions, 
and new programs while current services arc practically 
ignored . 

5) Too little emphasis on developing an' 1 comparing alternatives* 

6) Inadequate determination o. f : future costs associated with 
present decision. 

7) Failure to integrate operating and capital budgets* 

. 8) Deficient utilization of cost benefit and cost-ef focciveness 
analysis when appropriate. 

The cycle emphasises and provides central management with 
centralized control ever the budgeting process. Centralized control 
is initially desirable in METKP because of the experimental nature 
of the project. It is felt that centralized control of funding 
requests, resource allocation, and educational evaluation and research 
will enhance efficiency, effectiveness and success in the MiiTEP 
project . 

The cycle provides for incorporating traditional school and 
state fiscal procedures with those found in a PPB system. Since 
MKTbP seeks funding through the university and state, the integration 
of traditional budgeting procedures with PPJJ procedures is both 
desirable and necessary. 

The internal budget cycle is divided into four distinct stages 
as well as specific time periods. Each stage plays an important 
part in the development of funding requests and the project PPB. 

Since deficiencies in any stage are likely to cripple the overall 
effectiveness of the budget system, the time tables and procedures 
associated with each stage need to be given proper support by central 
management. Figure 1 is a flow diagram of METEP*a internal budget 
cycle without dates, Figure 2 is a flow diagram of MET IIP 1 s tota l 
budget cycle, from budget design to funding, with dates. 

The first stage is essentially a review of project objectives 
and the development of project guide-lines for the budgeting process, 
This involves gathering and organizing all information needed by 
program coordinators for the creation of program PPB’s, Central 
management coordinates this intelligence activity. After the intel- 
ligence activity is complete, central management sends out appropriate 
information to both subsystems and program coordinators • Along 
with tills inof mat ion goes a detailed policy and procedure guide 
which relates to the development of Phil's for the educational and 
admins trative components , 
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The second stage gives rise to the development of subsystem 
and program I’J’B's. Each coordinator works with his personnel to 
create n PPB for lii.s area. This involves the analysis and inter- 
pretation of the intelligence provided by central management in 
light of the program's objectives and present activity. Such an- 
alysis and interpretation leads to the projection of future activity 
levels ami related needs. Kith this information, program or 
subsystem changes are planned and programmed, there significant 
changes are contemplated, their effect on future program output 
and cost should be analyzed. Once a coordinator is satisfied with 
plans made, alternatives chosen, and has reviewed last years PPB 
for overlap, a tentative area PPB is developed. The area Pi'B is 
then sent, to central management for review and eventual consolida- 
tion with other area PJ’B's into the tentative project Pl’B. 

In the third stage central management reviews each area PPB. 

If obvious deficiencies arc apparent the area PPB is sent back for 
revision. If it is not sent back in the first review, it is con- 
solidated with other l’PB's. Eventually a project PTB evolves from 
this consolidation. Once t lie tentative project TPB is complete, 
central management, working with updated financial constraints and 
having evaluated the contributions of particular subsystems < *:d 
programs to the success of the METE? project, will begin reviewing 
in detail the budget requests of each area. At this point, central 
management interjects its decisions pertaining to the overall di- 
rection of the METEP project. Working with information derived from 
the educational research subsystem and other sources, central 
management can add, cancel, or modify programs to increase the 
efficiency and effectiveness of the iiETEP picject. Where modifica- 
tion is appropriate, central management will consult with one or 
more of the area coordinators to develop an acceptable Prn. This 
task often involves returning area ITB's fer revision until 
consensus is attained. 

The definitive project PPB is developed from revised area PPB's. 
Tills budget is the basis for future funding requests in the. appro- 
priate fiscal year. In the last phase of the third stage of the 
budgeting cycle various funding requests are sent to proper agencies 
for further processing. Likely, the definitive project TIB will 
undergo additional modification as the various funding agencies 
examine and act upon the original request. Stage four gives rise 
to the working or finalized project PPB. Once it is apparent 
exactly how much funding is available to METEP, a finalised project 
PPB is developed. 

When this budget is complete it is sent to each subsystem and 
program. Coordinators arc now able to draw upon the funds available 
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according to their budgeted amounts. Tills working I'PB provides 
a basis for regulating and coordinating area expenditures. 

Central management consists basically of the following core 
personnel: 1) project, director 2} associate director of education, 

and 3) associate director of administration. It also, at tiros, 
includes those individuals who are specifically required to serve 
in an advisory capacity when particular expertise is required during 
the budgeting process. 

This arrangement is suitable to MKTLP requirements in that 
it can provide for a high degree, of flexibility and expertise nj 
circumstances in the budgeting cycle change. The cove triad is 
adequate for most decision making in the budgeting process. It 
is sufficiently large, to provide diverse points of view, and yet 
small enough to act decisively on matters requiring decisions. 

HKTK P Budget Res p onsibi lities and Procedure s. Budge responsibilities 
in the METEP project arc distributed among the following ranked 
individuals : 

1. project director 

2. associate director c£ education 

3. associate director of administration 

4. subsystem and program coordinators. 

These individuals have certain responsibilities and authorities 
in the budgeting process. 

Foremost among the responsibilities of the METEP's project 
director is that of establishing policies governing the scope and 
activity of administrative subsystems and educational programs. 

This responsibility is executed by the anticipative design approval 
or negation of program an* subsystem plans, their associated budgets, 
their Administrative organizational patterns and other matters of 
general applicability. The director will determine and implement 
general policies needed for the initiation of the project. The 
need for policy revisions and/or additions will rest within the 
workings of the total organization. The need for a particular policy 
statement or decision will first become apparent to the administra- 
tive officers, faculty, or general staff. Their recommendations 
would then nove upward through the organizational channels to the 
project director for appropriate action. 
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This points to the CncL that the project director is primarily 
concerned with general policy. He is not only indirectly concerned 
with policies related to the methods by which the subsystems and 
programs budget proposals are conceived , developed and presented, 
the project director is also directly involved in the preparation 
of the definitive project f s PPB, From this point of view* it is 
evident that the project director plays a vJtal role in nearly all 
the stages of the budgeting cycle. First, he helps to establish 
project objectives and guide-lines necessary to the development 
of subsystems and program PPB’s. Second, lie participates in the 
creation of the tentative project PPB, He provides the overall 
leadership necessary for directing the future of the METEP project. 
Thin involves him in decisions relating to the addition, cancellation, 
and modification of subsystems and programs within the immediate 
organ! national structure. Third, he heads the team responsible 
for the preparation anJ submission of the definitive project PPB 
and funding requests. It is he who has the rosponsi bi I i ty of 
supporting, defending, and if need be, modifying the definitive 
PPB. Forth, he is ultimately responsible for the financial control 
of funds provided to support the MKT HP project. This means the 
working METEP PPB is an extension of his responsibility. 

In summary, the following functions arc performed by the project 
director in the budgeting process: 

1 . Determination of general policies to control the sphere 
of activities let subsystem and program. 

2. Establishment of fiscal plans and policies. 

3. Alteration and modification of overall project direction. 

4. Execution of project’s FFB and related funding requests, 

5. Execution of other budgetary procedures which he deem3 
desirable or necessary. 

The associate director of education is directly responsible 
to the arograw director in the budgeting process. His scope of 
activi is largely limited to directing and coordinating the 
develoi’i^mt of the educational ptograa budgets. He directs the 
evaluation of educational programs. He supervises educational 
research. He also acts in the capacity of advisor to the project 
director. 

In this advisoiy capacity he ca • greatly affect the future 
direction of the 1IETKP project. This ability nakes hin a key figure 
in the development of a project TPIj. 
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In the absence of a project director ho. assumes the director's 
budgeting responsibilities , 

The associate director- of administration is directly responsible 
to the project director. When the project director is not present, 
ho is responsible to the associate director of education, ibis 
officer's responsibility in the budgeting process is more detailed 
than either the project director or the associate director of educa- 
tion. His efforts are concentrated in the administration and coor- 
dination of the administrative subsystems. In this role, he has 
the responsibility of directing and coordinating the development 
of subsystem JTb's. 

He is also the financial officer of the MKTD* project, lie 
is rcrj-onsible in this function for the overall supervision of 
accounting activities and budgeting procedures within the 11LTI.P 
project. This means he regulates the technical and titling aspects 
of the budgeting process. In addition, he is charged with deter- 
mining and promulgating accounting policies and procedures, main- 
taining the adequate form the accounting records of the project, 
preparing and interpreting financial reports as the need arises, 
making recommendations for e-tocutivc or other action indicated as 
necessary or desirable by the reports, soliciting funds for the 
MHTF.P project., Administering financial controls with respect to 
receipts and expenditures, including budgetary control, supervising 
internal audits of the HKTEP project, and performing other financial 
functions as required. 

More specifically, his budget resptisibili ties are: 

1. Formulation of the budget time schedule and necessary 
budget forms. 

2. Preparation of guide-lines and procedure directives as 

to the design, development, justification, and submission 
of the area PPB's. 

3. Direction of cost analysis of existing programs and proposed 
alternatives. 

4. Initial analysis of area PPh's. 

3. Consolidation of area PPB's into tho tentative project PPB. 

6. Supervision of central management's review of the tentative 
PPB and the related subsidiary area PTEs. 
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7, Initiating modification of area PPBs as a result of central 
management 1 v review decisions. 

8, Restructuring t lie tentative PPB into l lie definitive project 
PPB. 

9, Organizing, structuring, coordinating, and submitting state- 
line lien, federal, and oLhor funding requests wi Lh appro- 
priate supportive infori.vj Lion . 

10. Supplying any other budget justification an directed by 
the project director or funding agencies. 

11. Supervision of modification to the definitive project PPB 
as resources are made available by t tie funding .agencies. 

12. Presenting the working or finalized project PPB to area 
coordinators as a fiscal guide. 

i; Administration of expenditures and other details associated 
With the project PPB, 

Subsystem and program coordinators are responsible to their 
respective supoi viyuis , either the associate director ci education , 
or adminstration. Hack i s responsible for directing, organizing, 
coordinating, and administrating the activities found in his 
particular area of responsibility. Their rclc in the budgeting 
process is to formulate, their area PPB. This entails analyzing 
central management guide-lines for their effect on the future 
operations of their area. It also involves planning and programming 
future area funding requirements once guide-line analysis is 
complete. Wien the area’s future requirements are analyzed and 
detailed in the area PPB, coordinators are required to subnit 
justification of their funding requests along with the PPB. They 
will, when required, modify their budget reposals and resubmit 
them, 



In essence, these individuals will: 

1. Cooperate with the associate director of administration 
by following established policies, procedures, and guide- 
lines pertaining to the budgeting process. 

2. Analyze present area operations and future needs, 

3. Perform "cost-benefit" and "cor* t-ef feet iveness" analyses 
when appropriate. 
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4. Develop and submit area PPBs nnd supporting justifications. 

5. Cooperate when they are requested to modify their area 
budgets . 

6. Provide any additional help in tbe budget process at the 
request of the project director or one of the associate 
directors. 

The Eightee n M onth Budgeting C ycle Tine .Sch e dule, The total MKTEP 
budgeting cycle ("Figure 2) is complex because Mk’iT.P must seek 
funding iron many sources. Each source prescribes and requires 
essentially different procedures for funding requests. Bach source 
also has the ability, in fundirg, to materially alter METEP’s 
financial plans. The IICTEP budget is in a constant state of flux 
until funding actually takes place; once funded, a finalized budget 
can be developed. 

Tbe tine schedule for the METEP budgeting process continues 
over a period of eighteen months. The first date of importance is 
January 1. It signals the start of the initial stage of the 
budgeting cycle. Shortly after January 1, the associate director 
of administration begins to collect guide-line materials from 
established channels. Through the month of January, he construct*} 
a set of instructions vhich will he used as a guide In the develop- 
ment, preparation, submission and justification of subsystem and 
program PPB requests. Once complete, these instructions will be 
included in a kit which contains time schedules, procedures and 
forms . 

On or about February 1, these materials arc transmitted to 
various subsystems and programs for appropriate action. For tbe 
next sixty days coordinators will work to develop their area PPB’s. 
Once their PPBs are developed, they are sent to the associate 
director of administration for review and further processing. All 
area PPBs must be in the associate director's office on or before 
April 1. 

April 1 signals the preparation of a tentative project PPB. . 
Thl9 entails reviewing area i’PB'c before they are consotidated into 
tbe tentative project PPB. Any found obviously unsatisfactory arc 
returned to the appropriate coordinator for modification. The tar- 
get date for completion of the tentative project PPB is April 10th. 
From April 10th to May 15th central me lagemnt in consultation with 
area coordinators, can modify the overall tentative project FFB. 

Also during this time the tentative project PPB will be presented 
to the Assistant Dean for Administration, School of Educative . 
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11 10 . Assistant Dean will be requested to review the budget and to 
recommend which portion*; would be appropriate to include in the 
school's budget request. 

by May 15th a definitive project PPL should he developed. 

The associate director of administration and his staff will determine 
how Lite project PPB vi.ll be broken down into funding requests. 

Funding requests vi.ll bo pioparcd, reviewed and submitted by June 1. 

by June 1 t lie project director will have Acquainted himself 
with every facet of the project’s PPL. The project director and 
his staff will have the responsibility of maintaining working 
contacts villi various school, university, state, federal, and other 
funding agencies until funding for the budgeted year is completed. 
This means I lint tlu* project director and his staff are to be avail- 
able to explain and justify the original request and, when necessary, 
submit and explain any alterations j;i budgeted needs which may he 
reflected in changing KCTKP requirements during the remaining twelve 
months of the budge cycle. 

When the total amount of funding available to METLP becomes 
known, the project director mid the asj.ociatc director of adminis- 
nation will supervise the preparation of too working project PPL. 
This should occur as near as possible to duiy 1 the begiuiinig of 
the fiscal year to which the working PPB is to he applied. 

Imjvl Comments . When the implementation of the MKTEP is 
funded, tb . five-year budget and financial time schedule (developed 
in 1 lie feasibility study) will he evaluated in terms of the avail- 
able funds and designs of the Various pedagogical programs. The 
result of this evaluation will bo a finalized five-ye^r budget and 
plan for raising any necessary funds lo support the MLTLP during 
tills period. The associate director of adninlstrat ion will be 
charged with the responsibility of implementing the financial and 
PPB systems. It is anticipated that the proposed PPB system will 
require modification because of varying start-up conditions that 
may be encountered. However, for efficient operation of the system, 
emphasis must remain on the function of long-rnnge planning because 
of the eighteen month budgeting cycle that will be encountered. 

It is impossible to anticipate Ary changes that may develop 
in the financial and budgeting system of the University of Mass- 
achusetts. At this point in time, several changes appear in the 
leaking and should bo considered at implementation to insure a proper 
Interface between the IIKIEP and the University's system. 
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The School of Education is presently in the early design stap,e 
of developing a revifjed budgeting and no count: Jng system. Hie inter- 
face between the project'.*; and school's fiscal systems is discussed 
in the; description of tlie UETI.P accounting subsystem. 

figure 3 is a network activity diagram of the implementation 
of the budget subsystem. Although not explicitly illustrated, there 
ore implicit feedback loops and cycles of activities, lor example, 
data derived from the evaluation of the budgetary process will lie 
used to update the objectives and design of the subsystem, hence, 
many of the. stops in the network will be repeated. 

Most of the expenses of implement ing the proposed budgetary 
subsystem arc included in the budget estimates for the administrative 
subaysLen. Some costs associated with the automation of the fiscal 
subsystems are included in the management information system budget. 
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Accounting Subsystem 



The Trenaurer, the chief financial officer of the University, 
is accountable for the control and disbursement of all University 
funds. One of the functions of the Treasurer's office is to main- 
tain all official accounting records. This task i3 centrally 
performed. 

The Assistant Dean for Administration, School of Education, 
acting for the Dean of the School, is responsible for initiating 
official forn>3 notifying the Treasurer's Office to encumber and 
expend funds which have been allocated to the School. 

Trust, fund, i.e., fedora) and foundation grnntr. and contracts, 
are administered similar to the state allocated funds. Each trust 
fund is administered as a separate entity. The assignment of 
accounting categories is more flexible for non-state funds. This 
allots accounts to be established for compliance with federal and 
foundation guide-lines. 

The University provides a weekly report to the School noting 
expenditures and balances. The processing time between the 
initiation of an action and the reported completion it? normally 
three or four weeks. Therefore, the weekly University report is 
approximately a month out of date when received by the School. 

Hence, the School has found it desirable to set up a ledger system 
which maintains the current balances of all accounts. Encumbrances, 
their liquidations, expenditures, and cash balances are maintained. 

The present accounting systems, both University and school, 
are line-item accounts. (Ihe School is presently in the early design 
stage of dp.veioping a program approach to budgeting and accounting.) 
The IJETEP budgetary subsystem implies an accounting system which 
will provide noro data than either the present university or school 
systems. The only constraint placed on the project’s accounting 
subsystem will be the requirement of creating line-item financial 
report8 using the University account structure. Ibis requirement 
is necessary for comparing official university records and the 
project's "working" records. 

The disbursement and accounting of METEP funds will follow 
the University system with the following exceptions. The MKTEP 
Associate director of administration will initiate the forms necess- 
ary for encumbering and expending funds. These foims will be 
forwarded to Inc Treasurer of the University through the Assistant 
Dean for Administration, School of Education. The working ledger 
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will be maintained by the project t s associate director of adminis- 
tration. The official accounting record will rejunin the respons- 
ibility of the Treasurer* 

Accounting records maintained by the project will be used for 
the financial control of WKTisP. These records will provide critical 
inputs for cost-ef fectiveness analyses and PPB preparations. The 
associate director of administration will provide area and subsystem 
directors, with, financial reports when requested. 

The associate director will be responsible for reviewing the 
financial status of the project with the director and the associate 
director of education on a regular monthly basis. 

The accounting subsystem proposed for METEP will provide fiscal 
reports for: 

(1) Each educational area and administrative subsystem - 
program codes. 

(2) Control accounts by object codes - the present University 
account structure. 

(3) Cork'd activity accounts, c.g., instruction, admin i si ration, 
program diffusion and dissemination, program evaluation. 

The general framework of the proposed accounting subsystem 
follows from the proposed PPB subsystem. It incorporates the current 
public school practice of the utilization of a "Federal Accounting 
System" with program accounting. The following Figure A is used 
to illustrate the proposed subsystem. 

The three dimensions of the cube are: activity, object, and 

program codes. Each fiscal transaction is coded to: 

1) indicate the purpose of the expenditure or action - the 
activity. 

2) describe the materials or services acquired - the object, 

3) indicate the area or subsystem of the activity - the 
program. 

This three dimensional accounting subsystem will provide cost 
data necessary for PPE preparation and control. The comparison 
of expenditures permitted by this design is also beneficial in 
cost-cf fcct.lvenoss analysis . 
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Some of the comparisons possible using this design are; 

1) Supplies in science instruction (cube A-V-b) to 
supplies in language arts instruction (cube A-V-c) 

2) Total instructional cost Con tire layer A) to total 
administrative cost (entire layer B) 

3) Total mathematics program cost (entire slice a) to total 
science program cost (entire slice bj , 

The object codes will agree with the account structure set 
up by the Treasurer's office. Activity and program codes will be 
determined by the METEP associate director of administration. The 
activity codes will be reviewed by the School's Assistant Dean 
for Administration. 



A three dimensional, accounting system is sufficient for a 
program that derives all of its funding from the same source. Funding 
for METEP is anticipated from several sources. Therefore, although 
not included in the graphical illustration at the accounting sub- 
system, a fourth dimension is necessary* Codes will be established 
to indicate the source of the funds being used in a financial 
transaction. The coding requirements will bo determined by Hie 
HfclLP associate director of aclininisf ration . Ihci design cf the JILILP 
accounting subsystem will be revised, if necessary, to insure proper 
interface with the ne\* T accounting system now being developed at 
the School of Education. 



The Management Information System described in section III 
does not include an accounting subsystem. Any computerization of 
the accounting procedure will require additional computer program 
design, implementation and operation. 

Although the University maintains the official accounting 
records, a METEP accounting subsystem should not be considered 
redundant. Rationale for the accounting subsystem has been pre- 
viously presented. The relationship between the School of Education's 
accounting procedures and METEP has also been described. However, 
there is one point which must be considered. 

Reference has been made to the development of a new budgeting 
and accounting system within the School, It is reasonable to 
assume that procedures will be appropriately automated. Therefore, 
is it feasible for METEP personnel to design and implement a separate 
system? 
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It is recommended that the 11KTKP fiscal subsystems be Implemented, 
The final design of the systems should be determined in cooperation 
with the School's Assistant lean for Administration, But, the size 
of the METEP operation and its experimental nature dictates the re- 
quirement of an autonomous fiscal subsystem. 

Also the stage of the development of the School's accounting 
system does not indicate that it will be operational in tlie near 
future, The assumption cannot be made that the School will be in 
a position to provide the necessary accounting support, I.e., 
automated program accounting procedures, when required for the 
implementation and operation of METEP, 

It is not unrealistic to predict that the design and implemen- 
tation of the METEP fiscal subsystems will provide valuable exper- 
ience upon which the School will draw in designing and implementing 
its budgetary and accounting system. 

The cost of the initial program design and implementation is 
estimated at $16,000 (not including overhead expenses). Most of 
the cost of the operational system is included in the cost of the 
administrative subsystem. The main additional expenses are program 
maintenance (revisions, updates, additions) and computer time, 

$4,000 is included in the operational budge for these items. 

Activities necessary in the implementation of the accounting 
subsystem are graphically illustrated in Figure 5, The operation 
of the subsystem includes the evaluation and updating of accounting 
procedures , 

Procurem e nt P rocedure. The METEP associate director of administra- 
tion will be responsible for procuring items and services required 
for the implementation and operation of the project, lie will 
familiarize himself with the procedures established by the univer- 
sity for purchasing materials, equipment, supplies, and services. 

He will be responsible for initiating all METEP procurement actions* 

Area and subsystem coordinators will be responsible for inform- 
ing the associate director of procurement needs, (The area and 
subsystem PPBs will provide the planning documentation required 
for anticipating most requirements.) The associate director will 
then determine the appropriate procurement action necessary to 
meet each need. 

The follovjlng is a general description of the university pro- 
curement model. 



475 




ACCOUNTING SUBSYSTEM 



kO 

13 



5 





476 



I 



The Assistant Dean for Administration, School, of Education, 
is authorized to prepare department., il purchase orders for the direct 
purchase of articles and repair services , Direct purchases may 
not exceed $100.00, Orders totaling more than $JOO.OO must he suh^ 
mitted on a purchase requisition to the university procurement office 
unless there is only one source of supply, then rlc partmontal purchase 
orders may be submitted up to a limit of $500,00. Justifiable 
emergencies, not in excess of $500*00, may also be submitted on 
departmental purchase orders. All emergency purchases must be 
approved In advance by the university procurement office. 

Departmental purchase orders and purchase requisitions are 
submitted to the procurement office for approval. Approval, must 
be obtained prior to the purchase of all itmes ns d services. The 
procurement office has the responsibility of contacting and nego- 
tiating with vendors. 

The University distinguishes between purchases which use state 
funds and purchases which use trust funds, e.g., Federal and founda- 
tions monies. The general regulations remain the same. Projects 
supported with, trust funds request "direct 11 purchases by submitting 
a Trust Fund Purchase Order. 

The University maintains a stock of supplies which may be ob- 
tained by submitting an interdepartmental purchase order. This 
service provides departments and projects with an economic method 
of obtaining supplies. 

Departments and schools maintain a record of the receipt of 
all purchased items and services. The Treasurer’s Office normally 
receives ull invoices. Invoices are sent to the School or department 
for approval of payment and are then returned to the Treasurer’s 
Office for payment. Invoices directly received from a vendor by 
a department or school are approved for payment and then forwarded 
to the Treasurer’s office for payment. 

The METEP associate director of administration is responsible 
for interfacing the project’s accounting and procurement activities, 
lie is also responsible for procurement interface with the Assistant 
Dean for Administration, School of Education. 

The steps necessary in the implementation of the procurement 
procedure are outlined in Figure 6, The associate director of 
administration will provide procurement support to all program 
and subsystem coordinators during the implementation and operation 
of nil components of the METEP system. 
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Co st-Ef f ccUlvonofts Modtil . Cost-ef £ ectiveness analysis is n process 
which relates cost and effectiveness (achievement) data for alternative 
courses of action. The cost and effectiveness data is presented in 
the same format for each alternative being analyzed. The format for 
relating and presenting data is determined by the needs of the person(s) 
who will use the data in his decision-making process. There is no 
specific algorithm for decision-making using cost-effectiveness data. 
Decisions should be based on all pertinent data available and should 
not be limited to the cost-effectiveness data. The following cost- 
effectiveness data will be used in developing area PPBs and in evaluat- 
ing the design of the system. 

The cost of each educational area is included as a separate 
section within the total program budget. These costs may be further 
broken down to be associated with instructional alternatives. The 
cost of some instructional alternatives may be easily identified, 
while the. assignment of cost to some lAs may be highly subjective. 
Therefore, the process used for determining the cost becomes significant 
in the later analysis of the cost data. Hence, the process should 
be documented and available when cost--eff ectivcness analyses are 
reviewed. 

Cost will also be assigned to area facilities, e.g., the cost 
of operating a learning lab will he calculated. There costs: wil l 
be divided Into two parts - fixed and variable. Fixed coat* are not 
effected by the student utilization rate while the variable costs 
arc determined by the utilization rate. For example, if the ]eb re- 
quires faculty or staff personnel to be present when the lab is open 
for students, then the salaries of the personnel will be considered 
a fixed cost. The cost of the replacement of expendable supplies 
and materials are examples of variable costs 

The cost of a lab will be divided among the instructional alter- 
natives which require the utilization of the lab. The varying require- 
ments for utilization of the lab for different IAs does not permit 
the generalization of a formula for allocating lab cost. These al- 
locations will be treated as separate cases. Mote: The cost of 

operating a lab does not include the capital cost associated with the 
purchase of permanent equipment and nonexpendable items. 

Personnel and staff cost are also assigned to instructional alter- 
natives for experiences other than lab. These costs may be both 
fixed and variable. 

The management information system will provide the following data: 

1. Number of students signing up for an IA 

2. Number and % of students pro-testing out of an IA. 
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3. Number and % of students post- testing in an IA. 

4* Number and % of students post- testing out of an TA. 

The cost and utilisation data will be presented in the follow' 
ing format (Sec Figure 7). Each IA for a PC will be represented 
by a dual linear bar graph. The top bar will represent the cost of 
providing the 1A. The bar v/ill be subdivided into fixed and variable 
cost. The cost scale will be found at the top of the illustration. 
The bottom bar for each 1A will represent the number of students 
who selected the IA. This bar will be subdivided into three parts: 
the number of students who pre-test out of the IA* the number of 
students who post-test out of the IA, and the number of unsuccess- 
ful attempts in completing an IA. The number scale will be found 
at the bottom of the illustration. The cost per student for each 
IA will be presented in parenthesis at the end of each dual-bar 
graph. 

This graphical representation of cost and achievement data will 
bo benefic .al in the cost-effectiveness analysis of the operating 
program. 

The same technique can be used in presenting data for explicit 
alternative courses of action where the cost and achievement data 
are either historical or anticipated. Therefore, the cost-effective- 
ness data can be used in making decisions pertaining to the deletion, 
addition, and/or alteration of instructional alternatives. It is 
extremely important to point out that the cost-effectiveness data is 
a necessary but not sufficient base for making decisions. For ex- 
ample, an instructional alternative may have a low utilization rate 
and a high per student cost while other TAs for the same PC may have 
high utilization rates mid low cost. Based entirely on the cost/ 
utilization data, consideration would probably be given to deleting 
the high cost alternative. However, examination of the type of 
student who successfully completes the high cost alternative may pro- 
vide additional data which would indicate the desirability of 
maintaining the high cost alternative. One of the inherent dangers 
of using cost-effectiveness analysis in education is the misuse of 
data by cost-oriented instead of student-oriented administrato\*s* 
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Instructional Alternative // 1 



METEP Five-Year Financial Budget 



The budget is a projection of the estimated costs of the con- 
tinued development and implementation of the MKTKP Program. The 
budget contains in summary form the total estimated costs of the four 
support subsystems and l'» educational programs which make up MJ:TKP. 
(See Appendix A.) Subsidiary budgets are also provided for each of 
the subsystems and educational programs which further delineate the 
estimated costs of development and implementation. (See Appendix B.) 
Proposed sources of revenue are indicated on the summary and sub- 
sidiary budgets. Federal support is phased out by the end of the 
fifth year with the State of Massachusetts assuming financial re- 
sponsibility of the program. The budget also assumes that some funds 
will be available from other sources during the second and third 
years of the project, e.g., foundation support: in the development of 
the urban education program. 

Costs are based on an achieving an enrollment of 800 full-time 
equivalent students, including both pre-service and in-service, in the 
system during the fifth year. All costs arc estimated in 1970 dollars 
and the summary budget in the final section includes a 4% inflation 
factor in order to estimate more accurately costs in the latter four 
years. 



A financial time schedule for planning, research* capital outlay, 
and operation of t’ e various subsystems and programs over the five 
year period is presented in Figure 8. 

The master budget lists four accounts. 

(1) Planning/Research: Includes the estimated cost of iden- 

tifying additional performance criteria and the development 
of the related instructional alternatives. Planning also 
includes the development cost of instructional material 
for the instructional alternatives. Planning in the Test- 
ing and Guidance subsystem includes the cost of develop- 
ing and evaluating the pre and post tests. Planning in the 
research subsystem includes the development of a monitoring 
system to evaluate the operation of METEP and a total system 
of evaluation during the fifth year. Planning personnel 
costs are included in this account. 

(2) * Operations: Includes supplies, maintenance and other es- 

timated costs to be incurred in daily operation of the 
system. 



METEP FINANCIAL TIME SCHEDULE 
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Planning Capital Out 



(3) Capital: Includes the estimated costs oC all Mi c equipment 

anti material with an estimated life of longer than one year. 

(4) Personnel: The estimated cost of all professional nr.d non- 

professional employees required by MhTIiP, 

The line items listed in the subsidiary budgets are aggregators 
of specific items and their estimated costs. The lengthy specific 
information is not listed in the report, but is available. 

The first seven educational program of the KETEP system arc pro- 
posed for implementation during the f irst year. These, programs ate 
in the final design phase and have been evaluated during the current 
feasibility study. The capital exuenditures of those particular 
educational programs include (lie cost of establishing .learning labora- 
tories that will be used by the students while studying in the various 
areas, lliese laboratories include audiovisual equipment and other 
devices that will bo utilized by the students while engaged in self 
study and formal classroom instruction* 

These laboratories must m.ee t space utilization standards if they 
arc to bo considered economically feasible* The University uses the 
following utilization standards. 



Classrooms . The average room is expected to be scheduled for 36 hours 
per week. The station (seat) utilization is expected to average 602, 
Tor example, a room with 30 stations scheduled for 36 hours would pro- 
vide 1080 station hours per week. Applying the 602 station utiliza- 
tion rate indicates that the room is expected to be used for a total 
of 648 student utilization hours per week. 



Laboratories* (Chemistry, physics, etc.) The average lob is expected 
to he scheduled for 24 hours per week. The station utilization is ex- 
pected to average fiOh* Applying these standards to a lab with 30 
stations would indie Ue the expected use to total 576 student utili- 
zation hours per week, 

11 a type of laboratory proposed for the. JJETEP project presently 
does not have a university utilization standard. These v?ill not a^rmal- 
ly be scheduled for group experiences. They are designed for indivi- 
dual activities. 

The space required for establishing KETKP labs v^ill come from ex- 
isting regular classroom space. Therefore, a case can be presented 
for setting the utilization standard of the labs the sarre as for a 
classroom. However, the lab will be serving individuals instead of 
scheduled groups, nonce, the following rsothod of determining if the 
labs meets university standards is proposed. 
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Let N denote the number of student; utilisation hours per week 
required tS^mecit the University standards prior to the conversion of 
tire regular classroom space. Let denote the time that a student 
spends in a visit to a lab. Hie summation of these times , «£ t^ , is 
the total time of student utilization. Therefore, to meet the Uni- 
versity standard: f* , for each learning laboratory. 

Results from the simulation model indicated that moot of the 
proposed labs met this criterion of space utilization. Updating si- 
mulation input data and refining the design of pedagogical programs 
and laboratories has resulted in an increase in the projected uti- 
lization of laboratories . Therefore* these labs for which tin* pro- 
jected utilization vr v c did not meet the standard are now consider- 
ed to be feasible. 

The following utilization standards are used in determining 
personnel requirements. 

A major portion of a faculty member’s time should bo spent in 
research and development oriented activities. Therefore, an aver- 
age of 7.5 student contact hours nor week is considered appropriate 
for planned inst met i.cnal experiences. 

MET UP staff members are expected to work 35 hours per wee!;. 
Graduate students financially supported by Mr'TK.P assistant ships are 
expected to participate in project activities 20 hourc per week. 

The student/faculty ratio set by the • talc of Massachusetts is 
fifteen to one. lienee, the proposed project, designed to servo GOO 
full time students, should have approximately 54 full tine faculty 
members. 

This number would he substantially increased with the Imple- 
mentation of the remaining nine educational programs. Hence, the 
results of the simulation indicated that the design of the project 
was not feasible when the student/faculty ratio standard was ap- 
plied. 

A review of the type of personnel required to perform in- 
structional tasks uncovered an error in the simulation input data. 
Graduate students in t He School c { Education are considei 1 as pa**t 
of the instructional staff. Several pedagogical areas had indi- 
cated that certain tasks were to be performed by members of the in- 
structional staff without distinguishing between faculty and gra- 
duate students. This was misinterpreted as solely a faculty res- 
ponsibility. Hence* the number cf required faculty was increased 
while the number of graduate students was negatively effected. 
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The staffing requirements generated by the simulation of the 
program were adjusted to reflect the correct utilization of fa- 
culty and graduate students. 

The staffing pattern used Jn determining the budget for ycar- 
5 is presented in Table 1, For ty-tvo full time faculty members are 
utilized solely in the instructional aspect of the program. twelve 
faculty members will have both instructional duties and responsibi- 
lities in the management, information, and research subsystems. 
Forty-six graduate students financially supported by the project 
will be utilized in instructional activities, including supervision 
of learning laboratories. Seventeen graduate students will be uti- 
lized in various administrative functions. The budget also includes 
seven positions foi laboratory supervisors. These individuals vri.ll 
be responsible for the maintenance and supervision of the labora- 
tories. The budget also includes funds for four psycho-netr ici ens 
in the research subsystem and forty affiliated teachers in the in- 
service program. Table 2 indicates student faculty ratios, faculty 
to secretary ratios, and faculty to graduate student ratios. 

lire proposed source, of revenue are illustrated in Figure ?. 

The phaEC out of Federal support is graphically presented. A com- 
pilation of the total cost of the project is presented in Table 3. 
Cost are presented in terms of 1970 dollars. 

Table 4 is a comparison of the present cost of the elementary 
teacher education program and the cost of the proposed system. 

The current operating budget of the School of Fducatioti does 
not reflect the total cost of the elementary teacher education pro- 
gram. The University does not allocate some funds at the depart- 
ment or school level. For example, the funds required to furnish 
heat are not allocated to the school. Other examples arc the cost 
of student services, control administration, and university se- 
curity. Therefore, the cost per student presenter in the projected 
budget are not total cost. 

The cost of the proposed HKTKF program is presented in a format 
comparible to the existing budget of the elementary teacher educa- 
tion program. Cost not considered to be relevant to the decision 
of replacing the current elementary teacher education program villi 
the proposed project are not included. The accounts and subaccounts 
of the projected budget are comparable loathe present accounts of 
the elementary teacher education program. 

The current expenditures for the elementary teacher progran is 
approximately $1,'*80 per studen.. This is the cost used in the com- 
parison presented in Table 4» 
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YEAR-5 STAFFING REQUIREMENTS 
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TABLE 4 

COMPARATIVE COSTS 
ALL 1970 DOLLARS - YEAR 5 



I. Current Systems 

500 F.T.E. Student i? 

Total Cost 
1970 Dollars 



AVG. /Student Cost 
1970 Dollars 

II. Proposed 

MLTLP System 

COO F.T.E. Students* 



Total Cost 
1970 Dollars 

AVG. /Student Cost 
1970 Dollars 

Comparison (Old) 
(New) 



Difference 
X Increase 



$ 790,000 (State) 

Operations 

$ .1,580 



$ 254 , 500 
1163,500 
25,000 
132,500 



5 Year 

(State) 

(State) 

(Fed.) 

(Fed.) 



$1575,500 



_ _L»969 
800 / 1 , 575,500 

$ 1,580 

1,969 

$ 389 

24X 




Personnel 

(Only) 



Operations 
Personnel 
Operat ions 
Personnel 
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Tlu; indicated increase! in enrol lir.ent fro.n 500 to GOO F.T.K. 
students will partially result from tlie implementation of the in- 
service program. This program, closely interfaced with project dif- 
fusion, nliould result in tlie enrollment of many in-service ele- 
mentary leaclicru. 



Although the present account lng system is not program oriented 
it is possible to estimate the cost of the elementary teacher edu- 
cation program. 
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Economic Feasibility: Conclusion 



The concept of economic feasibility was introduced by posing 
four questions a family usually considers in deciding the economic 
feasibility of a purchase. These four questions were then applied 
to the proposed KhTEP project. 

Processes for determining cost mid controlling expenditures 
were presented in response to the questions: 

1) How much will it cost? 

2) Do w r c have sufficient financial controls to insure 
the expenditure of funds according to a planned 
program for payment of the purchase? 

The program cost and sources of revenue were presented in A five- 
year budget* The key cost data are the projected developmental 
(including initial capital outlay) cost and the operating cos!:* 

The five year unadjusted total for developmental expenditures 
is $3,382,000. This number includes expenditures for equipment, 
facility modifications, and the funds allocated for the research 
and development of processor and materials, ftot included ere 
personnel and operational costs- 

The projected operating cost after the implementation of t lie 
program is $1 ,969 per student. This includes tho cost of evalu- 
ating, reviewing, and updating the program* This is not the total 
per student operating expenditure of the University. The distinc- 
tion between the program and University operating expenses is ex- 
plicit in the discussion of the proposed budget. The per student 
operating cost of the present program adjusted for comparison vilh 
the operating cost of the fifth year of the proposed program Is 
estimated to be $1,580. Assuming that the adjusted non-program 
operating cos*: would remain constant, the incremental pre-student 
cost of the proposed program is $389. 

The budget, accounting, and procurement procedures were de- 
signed to insure appropriate fiscal planning and controls. 

Several criteria were suggested for determining - "Can we af- 
ford it?” The first of these criteria is related to the appropri- 
ateness of Federal support of the program. The point was made that 
the Federal government cannot afford to provide funds for "per- 
manent” programs where there is little or no intention of continuing 
the program past the Federally funded period. The phasing out of 
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Federal support ns illustrated in the proposed five year budget de- 
monstrates the intentions of the School* Letters of commitment to the 
METEP concept will be provided in the Phase III proposal. 

An appreciably small incremental cost per student program was 
the second criterion for determining the School's ability to support 
the program. The incremental cost of $389 per student does not 
meet this criterion. This negative result will be subsequently dis- 
cussed in the concluding remarks. 

The ability to facilitate the effective use of funds is a third 
criterion in detei'mining "can we afford it." The application of 
cost-effectivcness analysis and the PPBS approach t:o fiscal planning 
and control complemented with a strong pedagogical evaluation com- 
ponent are designed to satisfy this criterion. 

The answer to the first of the four original questions is the 
most subjective. "Is this the best use of our money?" can be 
answered only by reviewing the rationale and goals of the project. 

The rationale for the METEP project; can be summarized as 
follows : 

1) For education to be truly responsive to the changing needs 
of both society and individuals, education#] goals and 
their criteria must be an integral part in the initial 
planning and operation of learning experiences. 

2) The process of change must be inst itution.il ized so that 
it becomes an integral part of the education structure. 

3) The criterion of time currently used to measure the edu- 
cational progress of a student is at best only incidental- 
ly relevant to the student *s ability to perform. 

4) Optimal individual learning situations may be created 

if educators learn to correctly match teachers, materials, 
structures, and students. 

5) A flexible teacher education structure is required if 
new alternatives for improving instructional and 
learning experiences are to be conceived, implemented, 
and evaluated. 

The METEP project represents a concerted attempt to face the 
challenges of institutionalizing change, social relevance, and indi- 
vidualized instruction within the framework of a teacher education 
program. 
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Although the project at the University of Massachusetts is pri- 
marily a research and development program, the modular design will 
allow the training aspects of the program to he duplicated at other 
institutions. The operating cost of the training portion of the pro- 
gram would he dependent upon the size and intensity of the program. 

The faculty utilization standard of 7.5 contact hours per week used 
to cost the proposed program is not a realistic standard for a teach- 
ers* college. Personnel cost is the major item in the operating ex- 
penses of the program. Therefore, a faculty utilization standard of 
12-18 contact hours pec week would have a sharp effect on the cost 
of the program. This reduction in cost could be partially offset if 
the college does not have a graduate program. Additional faculty 
and staff would have to be added to replace the graduate students 
utilized in the proposed system. Hence, the cost of duplicating the 
program istrighly dependent upon the existing educational programs of 
the recipient institution. 

Is the implementation and operation of the proposed research 
and development project the best uf;e of available money? The School 
of Education, University of Massachusetts, submits that it is. The 
rationale and goals of the program support this conclusion. The 
projected increased operating cost is justified by the innovative 
and evaluative potentials of the program. 

The MF/iFP project will also provide certain benefits to the com- 
munity and university. The new in-service program will involve ele- 
mentary school teachers from area schools. These teachers will also 
participate in this program and be exposed to the latest teaching 
methods. The urban education program will make student teachers 
aware of the problems that exist in teaching in urban areas and will 
hopefully encourage some of them to commit themselves to a teaching 
career in these areas. The research subsystem will also perform 
research and evaluation for public schools. The language arts pro- 
gram includes a reading clinic where the latest techniques will be used 
to improve the skills of children who have difficulty in reading* The 
technology program includes a computer with remote terminals. These 
terminals will be used in problem solving in the areas of technology, 
mathematics, and science. They will also be available for use in the 
other educational programs. Learning laboratories, e.g., mathematics, 
science, and social studies, will be available on a limited basis to 
other students of the University. The METEP project will also sup- 
port graduate students. This financial support will make it possible 
for deserving students to further their education 

These benefits are important, however, they should be a second- 
ary consideration in determining the merits of the METEP project. It 
is the concept of a flexible structure for institutionalizing change 
integrated with the concepts of formative and summative evaluation, 

PPB, cost-effectivcness analysis and simulation modeling that supports 
the economic feasibility of the proposed teacher education program. 
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SECTION V SIMULATION MODELING IN METED 




SIMULATION MODELING IN METEP 



Simulation and modeling techniques allow planners to see how 
certain aspects of an operation might work without actually going 
through that operation. The success of these techniques is highly 
dependent on the ability to describe the proposed opcratJ.cn well 
enough to allow it to be decomposed into simple ^artw> the behavior 
of each of v?hich can be clearly understood. It further depends on 
the ability to be specific about the inter-relationship of the parts, 
and to supply reasonable data for the operation of each part, 

A simulation .ncdel is properly validated when its total behavior 
in some way matches the real world. This is difficult to claim when 
the simulation model is to be used for constructive planning of 
something that doesn't yet exist. The value of constructing a 
simulation model in the planning context may be summarized as: 

a. The exercise of creating a model is very valuable in helping 
planners think through the consequences of their assumptions. 

b. To the extent that parts and relationships have been correctly 
specified, the consequences of system operation with hypoth- 
esized data may be explored. 

c. The cost of simulation is relatively low compared to the cost 
of a major error in planning. 

d ♦ The process of simulation can materially speed the process 
of developing a management control system for a complex, 
new operation. 

Our concern is not with individual components as much as it is 
with the entire entity — students, faculty, resources, management 
strategies. Simplicity of individual elements does not necessarily 
imply simplicity of the whole. By analogy, pulleys are simple 
components. However, the linking together of a number of pulleys 
with cord may produce a system whose behavior, when a weight is hung 
at one end and a force is applied at the other, is by no means 
intuitively obvious. The benefits of simulation modeling include 
gaining an understanding of the complete system through detailed 
descriptions of relatively simple parts and the hypothesized 
relationship between these parts. 

For the purpose of developing and testing the Model Elementary 
Teacher Fducation Program through simulation, it appeared obviously 
desirable to try to think through what would happen to individuals 
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under various circumstances. If reasonable experiences cannot be 
provided for one or more types c students, or some segment of the 
faculty, there is something wrong with some pari of the proposed 
program, Further* aggregation of the requirements for individuals 
should give a good measure of the resources needed by the Institution. 

Against this background, the. Simulation team has produced and 
used four models (a fifth is under development). The technical 
details of these models, including flow logic and examples of data 
used, will be included in a Technical Report to be published 
separately, These models may be summarized briefly as follows: 

EDSIM 1. This is an elementary model whose main purpose 
is to explore time to completion. The instructional prog. am 
developers in each pedagogical area are asked: 

a, The probability of passing pre-tests for performance 
criteria in that area, and, hence, needivig no 
instruction for a student, 

b, The probability of passing post-tests after instruction 
has been taken. One additional instructional alterna- 
tive is needed for each post-test not passed. 

c, For up to 10 types of instructional events, how many 
there are of chat cype and the estimated time for 
completion of that type by average students. 

In addition, an EDSIM 1 run requires the number of students to be 
processed and the per cent of the available i ns tructional events 
in each pedagogical area to be taken (in one "profile") • The 
model then generates the required number of students, one at a 
time, and has them take a number of randomly-selected instructional 
events In each area, based on the indicated number to be taken minus 
the number probabilistically pre-tested out, plus the number 
probabilistically failed on the post-test. The students time to 
completion, In hours, is tallied, and the hours typically spent in 
each pedagogical area is computed. 

The primary use of EDSIM 1 was to start the METEP modeling 
process. However, initial runs did show rather unexpected amounts 
of student time in different areas, which resulted in a shortening 
of time requirements in some areas for some profiles. 

In EDSIM 1, there was no attempt to see If students actually 
could be scheduled so as to complete their requirements in the number 
of hours indicated, nor was there any attempt to keep track of 
individual Instructional alternatives for individual students. 
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EDSIM 2, This was the major mode] produced during the 
feasibility stud> phase of METEP. It required the specific 
identif iration of all instructional alternatives, including 
resources of various types required and estimated student 
time to completion. Other data used in EDSIM 2 included: 

a. Probability ef passing pre-tests in each area. 

b. lumbers of students centering METEP at various times 
(e.g. start of semesters). 

c. Number of hours a week students were assumed to be 
willing to work, 

d. Amount of each resource assumed to be available. 

e. Per cent of the performance criteria to be met before 
completion of the program. 

For each run of EDSIM 2, specific students were generated, with 
specific sets of instructional alternatives to be taken. For each 
two week period within a semester, instructional alternatives were 
offered, depending on student demand and resource availability. A 
record was kept of each individual student’s taking and completion 
of instructional alternatives. Wien a student completed the 
specified per cent of the instructional alternatives, he was 
graduated . 

Output data from EDSIM 2 includes time to graduation for students, 
resource utilization by two week periods, and a tally of student 
disappointments due to such factors as insufficient demand, no space, 
no staff, or more demand than the resources permitted meeting. 

Data was collected from the Pedagogical teams for use in EDSIM 2. 
Undoubtedly, this data represented best guesses at the time it was 
collected, but, unfortunately, the time needed to collect and process 
a large amount of input data and run EDSIM 2 prevented refining the 
data to reflect experience gained by trying actual instructional 
alternatives this fall. Our separate technical report will document 
the data collected to indicate the working of EDSIM 2. This data, 
and the results presented, do not now represent our best knov:ledge 
of how METEP might work in practice. 

From the use of EDSIM 2 with the data as collected, several 
valuable interactions with Pedagogical teams and management refine- 
ments were generated. One of the major indications from the 
simulation experience was that some kind of scheduling of instruc- 
tional alternatives in advance, rather than in unforeseen response 
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to student demand, would greatly speed a student’s progress through 
the MET EL' experiences. Mathematics and Language Arts did experiment 
with various ways of clustering their offerings, so that students 
still had a reasonable choice, but in addition faculty resources 
could bo planned in advance. 

Another major suggestion from the simulation experience was that 
instructional alternatives were taking too much student time* Either 
a student needed to meet fewer of the hypothesised performance 
criteria, or the available instructional alternatives had to be 
shorter, if students were to exit from KETEP system in any reasonable 
time, For example, the Science area, in their feasibility testing, 
found that many more performance criteria were pre-tested satis- 
factorily and that many instructional alternatives took much less 
time than originally expected, A significant cut in both the number 
of performance criteria to be met and in the instructional time to 
meet them should generate data that contains the solution to the 
problem of lengthy time to graduation. 

The preference of students for lectures, although perhaps a 
function of conditioning of present students rather than a long- 
range indication of what is likely to be selected, reinforces the 
concept thet some efficiencies of large group, scheduled exper- 
iences will result in a smoother student flow through KETEP. 

Another interesting observation from EDS1K 2 concerns the number 
of hours per week students are willing to work. Theoretically, the 
harder a student is willing to work, the sooner he is likely to 
complete his program. In simulation, increasing the hours per week 
students were willing to work imposed severe strains on the resources, 
and served more to increment disappointment counters than speed 
student progress, A1 ternativcly , a higher level of resources may be 
needed . 

Demands on resources, especially faculty and staff, can be 
quite uneven. It would appear from F.DSIM 2 results that minimum 
number of students needed before an instructional alternative will be 
offered results in cumulative pent-up demand for many students, 
resulting suddenly in enough students for many instructional alter- 
natives at about the same time. It would seeir from preliminary 
analysis that this problem could be avoided through some form of 
scheduling . 

Many times during a semester, and especially towards the end of 
a semester, students had "idle” time due to inability to schedule 
instructional alternatives (primarily due to lack of sufficient 
demand, secondarily due to lack of tine until end of the semester). 

One possible strategy for ML'fEP planners is to provide more individual, 
self-study alternatives that could be used to fill in the gaps. 
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/ 7 tevnatively , some form of advance scheduling of instructional 
alternatives | perhaps into a select but varied number of consistent 
and efficient routes to program completion, might get around the 
"idle time" problem, and at the same time speed student progress* 

EDSIM 4 is still being created. It will use the same data as 
EDSIM 2 and try to provide answers for the sane kinds of questions. 

The present intent is the EDSIM 4 will have a sounder theoretical 
and data base (profiting from experience in building EDSIM 2), will 
be more flexible, and, hopefully, be easier to run. 

There is much that remains to be done with the EDSIM type of 
simulation modeling. Revising the input data to reflect experience 
gained during tills feasibility study is, of course, the most obvious 
and necessary activity. 

Model validation work is being planned in conjunction with the 
Individually Prescribed Instruction Project of the Learning Research 
and Development Center at the University of Pittsburgh. While it 
may not seem initially that individual prescriptions in an elementary 
school and student-selected instructional alternatives in a university 
setting have much in common, it now appears that operationally once 
a set of activities is selected, the behavior of the two systems may 
be very parallel. If the EDSIM models do provide bet ter- than- chance 
predictions of system behavior in the 1PI context, their usefulness 
tor MKTEP purposes is enhanced# 

In time, it is to be expected that operational data will be 
available that will allow a better than random mechanism for 
anticipating what instructional alternatives students will select. 

The development of a "guidance" predictor of some accuracy may be 
important if simulation models such as these are to become useful 
management tools for operation as veil as planning. 

There is a good chance that an effective simulation model may 
become a central part of the management information system. Looking 
forward to this possibility, work needs to be done to bring the data 
file structures of the EDSIM models into correspondence with those 
of the management information system. It will also bo highly desirable 
to provide a stable interface between simulation modeling and the 
research and evaluation effort, to provide both a research tool for 
the latter, and better parameters and decision rules for the former. 



i 




531 



I 



Two other small models have been created, ARF 1 is a scheme 
for defining the anticipated staff for a school or center, in terms 
of hours available, and per cent of time to he spent in various types 
of work, The work that needs to be done is then defined as a function 
of parameters of the educational program - e»g. number ol students, 
emphasis on indivudual instruction, planning time, The ARF 1 model 
matches work force availabilitv against work needed in a simulated 
school situation. One MKTEP Center, Language Arts, has applied the 
ARF 1 model to its staffing, with results verified by experience that 
there simply wasn’t anywhere near enough staff for the anticipated 
work. This type of analysis can be very helpful in designing 
staffing versus anticipated work in a new educational situation; its 
use in other METEP Centers is proposed. 

The remaining model is QURUE , whose purpose is to explore 
probable student demand for a limited service facility. The average 
arrival rate of students is specified, as is the anticipated service 
time for a student or group of students to be served simul taneously . 

A starting number of service facilities is specified. The model, 
which operates on a time-sharing system from a desk console, creates 
sample days with the specified student demand, then services the 
demand with 1 through the specified number of service facilities 
available. Information presented to the user includes average 
facility utilization and student waiting time, If the student 
demand and service times are known with any certainty, this model 
assists planners in deciding how many service channels should be 
available. A typical use has been to determine the number of 
Language Masters to have available for a given school population 
with anticipated use parameters, It was found that peak demand 
could be met with about half the devices originally planned. 

We believe that the development of these simulation tools, plus 
growth of sophistication in using them, has been a major and 
worthwhile outcome of the MKTEP feasibility study. The capability 
has been established for making better decisions hs METKr plans 
progress . 

Recommendations for the continued use of simulation in the 
implementation and operation of MKTEP are outlined in Figure 1. 



Creation and initial use of these models was supported by 
General Learning Corporation in connection with the planning of 
the first educational facility for the Fort Lincoln New Town Project 
in Washington, D,C. 




532 





POOR OffGNAL COPY -BEST 

available at time filmed 



TNANC« or MOOcls 



SECTION VI CLIENT ACCEPTABILITY 
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CLIENT ACCEPTABILITY 



Any teacher education program has several so Is of clients. These 
include; students , parents, teachers, school administrators , and 
state cor Lification personnel, If a teacher training model is to 
successfully satisfy the needs and concerns of these clients, it must 
Involve them in the creation and early evaluation of the program. 

The goal of the Client Acceptability component of the feasibility 
study is to inform a representitive sample of interested lay people 
and professional educators of the proposed METEP design, and then 
to obtain their reactions to the program as veil as their suggestions 
for improvements . 

Client acceptability of METEP has been determined by using three 
different methods; 



a. 



b. 



A client conference was held in July 1969 to present the 
METEP design. At that time, the clients 1 reactions and 
suggestions v;ere gathered via reaction panels, questionnaires, 
and the Delphi Technique. 

State departments of teacher certification were contacted and 
asked to respond re HETKP's compatibility to existing certi- 
fication requirements. 

lh.de r gr rid vales participating in the podagogi cal feasibi lily 
stvtdics vv.ru vjMtse.yed, .md ashed to give their reaction': to 
performance criteria end other instructional procedures. 



The general reaction of the potential clients surveyed during the 
conference, and in the visits to various .state certification depart- 
ments, wore exceptionally encouraging as well as helpful, and will be 
given more detailed attention within the remainder of Ibis report. 

The survey of undergraduate responses will be handled within the indi- 
vidual pedagogical reports rather than in the client acceptability 
section* 



Tlie Cl ient Con ference. A client conference was conducted early in 
July of 1969 to get feedback on the basic components of METEP ns they 
had progressed to that time. Twenty-three clients composed of under- 
graduates in elementary education, teachers in the field , all levels 
of administrators from public and private education, parents, and 
state certification personnel were invited to the University to learn 
about the proposed model Elementary Teacher Education Frogram, and 
then comment on its strengths and weaknesses. The full dry conference 
began with a general presentation by Dr. James Cooper, the project 
director, and was followed by several MKTEP staff members, each giving 
a brief synopsis of what was being planned in their specific subject 
areas. Tlie conference participants had each been cent t copy of t lie 
MEIKP Thnse 1 report prior to the conference, and the morning session 
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served to bring them up to date on pirogress since the report was 
written . 

The second half of the conference was spent gathering reactions 
from the participants to be used in improvement of individual MISTED 
components. Feedback to the staff was received in three ways: first, 

a presentation was made by a six member reaction panel; second, a 
questionnaire v/as filled out by each of the participants; and third, 
a prediction of future public acceptability was given via the RAND 
Corporation, Delphi Technique . 

Reacti on Pane l. The enthusiasm shown for METEP was something more 
than we had expected from the traditionally reserved New England 
group, and it seemed to set the tone for the remainder of the con- 
ference. Reaction panel comments ranged from; M I think the concept 
of performance criteria is excellent, and the removal of time as a 
factor in completing course or degree requirements has long been 
needed. 11 , to "Great care must be given when preparing performance 
criteria, so as to include the essential Ingredients of teaching. 11 
Many questions were asked by the panel regarding quality control, 
undergraduate time commitment, local involvement, and the ramifica- 
tions for present teacher certification requirements. These and 
other questions v/ere responded to by the staff before the partici- 
pants filled out the "Client Questionnaire". 

Client Qu est ionnaire. Thirteen questions were asked on the ques- 
tionnaire. bach question was designed tc give the MJiTtP an 

idea of what parts of the program the clients felt were strengths 
or weaknesses, and in general, what their feelings were concerning 
the program as it had been presented. Included here arc the thirteen 
questions asked in the questionnaire. A random response, i.c., every 
fifth reply, is provided. 

1. Do you feci there is a need for revision in the mehtods used 
to train elementary teachers? 

"Definitely. There should be greater emphasis on the 
teaching of learning theory, the establishment and 
pursuit of behavioral objectives, and t bo develop- 
ment of techniques required to make the classroom 
a stimulating place*" 

"Yes. More early experiences with children are 
needed. Micro-teaching, strength training, etc., 
arc fine, but longer earlier periods of time with 
children ore needed." 

"Yes. Revision of so.fle traditional methods to 
meet present day standards are needed." 
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"Definitely yes. The area of human relations is 
one that needs much attention," 

2. Disregarding minor weaknesses you may have noticed in MKTEP, 
does the general idea of a performance based curriculum for 
teacher education seem to have merit? 

"Yes, Performance criteria seems a much more realistic 
parameter than time achievement. My personal reser- 
vation is that ample consideration be given to the 
environment in which the performance criteria is 
demons t lated . " 

"Very difinitely, it should help elevate the status 
of teachers and their quality, which will in turn, 
make the profession more attractive to competent 
students . " 

"Yes, curriculum const ruction has been talked about 
for thirty years. Tt is time for action," 

"Yes. However, there are many ancillary experiences 
that take place aside from pursuit of specific ob- 
jectives in the classroom, that should not be over- 
looked . " 

3. In your estimation, what are two of the most obvious v:eak- 
nesscs in the METEP as it now stands? 

"Potentially good teachers might be washed out on 
the basis of failure to meet performance levels in 
one or two particular areas." 

"Definition of a student teaching experience . " 

"It (METEP) may turn out teachers who are alike in 
method and personality." 

"At this point, the field experience needs smooth- 
ing and clarification." 

"The role and particulars of a "generalist" require 
more delineation, perhaps using a different term." 

4. What do you feel are the major strong points of METEP? 

"Flexibility allowing for 



individual izalion. " 



"it proyides the trainee with a better understand- 
ing of the education process and his role in it. 11 

"The great care given to analysis of the essential 
ingredients of effective teaching. This is reflect- 
ed in the specific subject areas." 

"Possible effects on certification, recruitment, 
differentiated salary structure etc." 

5. Would you hire teachers trained under this method? 

"Yes, background, depth and preliminary practice 
and understanding of youngsters would be. strong 
points . " 

"I can't honestly say. The extent to which I feci 
the candidate can develop rapport with her children 
is a key consideration which requires on the scene 
assessment . " 

"Yes, I might finally have a reasonable chance to 
predict teacher success and pupil-tcacher com- 
patibility," 

"Yes, provided they have been awarded ^ Coaching 
degree by liic University." 

6. What are some of the qualities you would look for in a 
teacher before hiring him? 

"Genuine love and concern for children and an 
ability to transfer knowledge." 

"Enthusiasm for learning." 

"Respect for children, flexibility, ability to 
listen rather than just hear." 

"Knowledge of subject matter." 

"Knowledge of content, knowledge of children, liking 
for people and the ability to get along with them 
and facilitate growth. 
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7. In your opinion, ore the above qualities being developed 
in the M1STEP? 

"Yes, assuming minimum requirements are realistic, 
vhirh I am sure they will be./ 1 

"Yes, they are certainly a part of the design." 

"Wot all." 

"Yes, particularly in the human relations field, 
this is an exciting area, but one which could be 
cisastrous unless handled by extremely competent 
individuals . 11 

"I question whether love and concern for children 
will be able to become a part cf this program." 

8. If a student had competed all of his course requirements in 
2 1/2 years and was considered qualified by the University 
and the state certification board, do you think he would 
have any difficulty obtaining a job in your school system? 

"I would certainly hope not. Today’s asinine 
assumption that four years equals teacher, 
certainly is not valid." 

"No, the fact that he has a degree vouli be 
sufficient requirement 

"No, provided the University has sufficient con- 
fidence in this program to award him a Leaching 
degree . " 

"Possibly. There is more to education than 
attaining measurable behavioral objectives." 

9. If a student took 5 1/2 years to complete all of his teacher 
certification requirements, would he be regarded with some 
suspicion or have any difficulty obtaining a job in your 
school system? 

"Tills would depend on individual circumstances . " 

"No. The first few teachers might, but I’m sure this 
suspicion wculd only be tnonentary." 

"As strange as it may seem, he would probably be 
mote readily accepted than the above student." 
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"No, I fee] he would be considered nereJy 
a more thorough and well trained person. 11 

10, Bo you foresee any difficulties arising for local school 
systems if teachers are trained according to perform- 
ance criteria rather than the present methods? 

"Just the difficulties of teachers and adminis- 
trators accepting something new." 

"No, I believe most superintendents would welcome 
this type of preparation after they study and 
understand it," 

"Some bad feelings will occur in the teaching 
ranks of those who "put in" four years, but 
time is a great healer," 

"Yes, it will likely force a rethinking and hope- 
fully a restructuring of existing curriculum and 
methodology, which means confrontation between 
■old and new 1 teachers, 

11, Bo you think parents and board members will be eager to 
hire teachers with the performance criteria background? 

"Hopefully, the movement* is bound to be in that 
direction, " 

"Yes, since teachers educated in the traditional 
method have fallen short of what is expected of them," 

"Yes * They are fed up with what they are getting 
now and ready for performance evaluation on the 
job as well as in the preparation," 

"Yes, there is some objectivity to performance 
criteria which would give confidence to the 
parents and the board." 

12, Bo you feel that the application of curriculum simulation 
techniques provide an effective means to study educational 
problems? 

"Yes* It will save a lot of mistakes later*" 

"Yes, Ke should have adapted this from industry 
long ago," 
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"Don't know enough about the approach to have an 
opinion . " 

"Yes, but 1 would need more data and experience 
to comment further, 

]3, In what ways should the University continue to involve local 
school systems with regard to Teacher education? 

"More cooperative efforts and more responsibility 
to the local teacher," 

"if METEP is accepted, we should involve all schools 
systems in re-educating existing teachers so as to 
eventually get teachers to use these same concepts," 

"By sending people from the School of Education to 
faculty meetings at the local schools," 

"Offering academic credit to teachers who will do 
field research or cooperative work with the School 
of Education," 

"Constant dialogue, Through gradual involvement in 
ways suggested in the MKTEP proposal, through more 
seminars and conferences for teachers and administrators 
You* enthusiasm end ‘dreams 1 ?re wvy i.i factious, 



Del p hi Te chnique ♦ The Delphi Technique As a method used for the sys- 
tematic soliclatat ion and collation of expert opinions. A technique, 
has been found, through research done, at the RANI) Corporation, to 
improve a group's success in decision-making and the prediction of 
future events, The technique is explained here by N.C. la 1 key of the 
RAND Corporation, in a paper prepared for the N ational Con fe renc e on 
Fluid Power , in Chicago, October 17, 1968, 

"Die basic characteristics of the Delphi procedures 
are: (a) Anonymity, (b) Iteration with controlled 

feedback, (c) Statistical group response, Anonymity 
is achieved by using questionnaires or oilier formal 
channels of communication, where specific responses 
are not associated with individual members of the group, 
Th) s is a way of cutting down on the effects of 
dominant individuals and reducing group pressure. 
Iteration consists in porfroming the interaction 
among members of the group in several stages; typi- 
cally, at the beginning of each stage the results 
of the previous stage are summarized and fed back 
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to the members of the group, an cl they are then asked to 
reassess their answers in light of what the entire group 
thought on the previous round. Controlled feedback allows 
interaction with a large reduction in noise. Finally, 
rather than asking the group to arrive at o common opin- 
ion, a consensus, the group opinion is taken to be a 
statistical average of the final opinions of individual 
members of the group. In the experiments we have con- 
ducted, the median opinion — that is the middle estimate 
where half the group is on one side, and half on the 
other— has turned out to be the most accurate, By using 
a statistical group opinion, group pressure toward con- 
formity is further reduced, and probably more important, 
the opinio n o f every member is ref lec ted In th e_g_rouj> 
res ponse . 11 



We felt the twenty-three participants at the conference, because 
of their varied public backgrounds, could use the Delphi technique 
to give us an estimation of the general public's acceptance of the 
METEP design. The participants received instructions on the use of 
the Delphi questionnaire at the conference, and completed the first 
round of responses at that time. During the follov?ing four weeks, 
participants were provided with revised information on the responses 
ef the other conference participants, and were asked to adjust their 
responses if they desired. At the end of this exchange, the results 



w ere col le c t cd , g iv I ng 






information on the ocHrnarpd 



acceptance of the METEP design by the general public, 
form is included in the Appendix A. 



A sample Delphi 



In the following questions, the participants were asked to respond 
to the questions by checking a number from 0 to 100 on a number line. 

In the first eight questions, "O" represents unacceptability and M 100" 
represents complete acceptability. 

1. M If acceptability could be placed on a scale from zero to 
one hundred, the general public would rate METEP as:" 



Median response - 71.9 

2. "If acceptability could be placed on a scale from zero 

to one hundred, the general public would rate c onvention al 
teacher t raining tech niqu es as : 11 

Median response - 49.9 
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3. "The teachers now teaching in public elementary schools 
would rate METEP as:" 

Median response « 74^6 

4. "The teachers now teaching in public elementary schools 
would rate conventional te acher train ing techni ques as: 11 

Median response 46.9 

3. "The administrators hiring teachers for elementary teaching 
positions would rate the teachers graduating from METEP as:" 

Median response ® 76 > 2 

6. "The administrators hiring teachers for elementary teaching 
positions would rate the teachers graduating from conv e n- 
tional teacher tr ain ! ng inst it u t ions as:" 

Median response « 59.0 

7. "Assuming that a teacher graduating from an average school 
of education would rate 50 in overall ability on a 100 point 
scale, where would a student graduating from METEP be rated 
by the public?" 

Median response = 7 3.6 

8. "How many years will it take for the METEP approach to become 
accepted as a valid method for training teachers?" 

Median response = 9. 5 



In the next two questions, the numerals 0 to 100 represent 
numbers of parents. 

9. "Out of 100 parents, how many see a need for elementary 

teachers with better training than they are now receiving?" 

Median response = 70.3 

10. "Of these same 100 parents, how many would see METEP as an 
effective improvement over standard training methods?" 

Median response = 7 0. 1 
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t * PIT J^^tineyiJL s. The METEP staff is aware that a 
growing state university, such as the University of Massachusetts, 
must consider a broad area «nd population when it involves prospec- 
tive clients in determining METEP 1 s feasibility. The combination of 
a mobile graduating student body and a geographical location that 
puts several of the nation's largest population centers within an hour's 
air travel, requires that client involvement include other states and 
educational systems as well as those in Massachusetts* MET UP has 
achieved this broad involvement by visiting the teacher certification 
departments in New York, Minnesota, and California. The purpose of 
each visit was to determine the compatibility of the METEP design with 
existing state certification requirements, to familiarise each of the 
states with the design, and to receive suggestions on ways METEP could 
improve the design to meet existing state requirements. 

Three weeks before the visit, each department was sent a copy 
of the METEP Phase 1 report and several questions to consider, regard- 
ing the general inability of the design to their certification require- 
ments. See appendix for a copy of the letter and questions. 

New York. New York presently requires, a Bachelor of Arts degree with 
24 hours in education, and a practicum experience, for teacher certi- 
fication. The state is planning to convert from its present method 
of teacher certification to a performance based procedure within the 
next five years, and found the METEP design quite compatible with 
their projected plans. Dr. Gazzetta, Director of Teacher Certifica- 
tion, was very interested in METEP, and discussed possible relation- 
ships that might arise between New York and the University of Massa- 
chusetts regarding the design of performance criteria. Dr. Gazzerta 
stated that any changes of the degree proposed in the METEP design 
would require study by their certification department, but that he 
anticipated few problems. 

Minnesota . The State of Minnesota is also in the process of revising 
its teacher certification requirements. Dr. Garalski, the Director 
of Teacher Certification, found the METEP design acceptable to 
Minnesota's standards provided tliat teachers graduating from the 
program had a Bachelors degree, and met the requirements for a 
Massachusetts teaching certificate. The proposed future plan for 
teacher certification in Minnesota would simply require a Bachelors 
degree in education from an accredited teacher preparation institu- 
tion for a two year teaching certificate. During the two year trial 
period, teachers ’would be expected to meet various performance cri- 
teria, ns set down by the State Certification Department, before being 
recertified for a five year period. 
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No conflict between the METEP design <nd existing or proposed 
certification requirements could be found. It seems in fact, quite 
possible that METEP teachers might go to Minnesota already prepared 
to meet the proposed performance criteria for a five year teaching 
certificate. 

Calif or nia. At the time of our visit to California, the Certification 
Department had just received word that the requirements it had been 
working under since November of 1968, were being replaced with the 
requirements that had been in effect prior to 1968. It seems the 
State Legislature found the standards they set in 1968 to be unreal- 
istic, and in the absence of an immediate solution, they were return- 
ing to the earlier requirements. 

Mr. Obradovich, one of the Departments 1 analysts, informed us 
of this change and stated that further changes were in progress within 
the State Legislature regarding teacher certification requirements. 
With the lack of definite longterm standards from which to base Ills 
judgments, Mr. Obradovich was naturally hesitant to comment on the 
compatabili ty of the METEP design with California Certification 
Requirements. 

The METEP staff will keep contact with the California Certifica- 
tion Department to determine if difficulties might arise for our 
graduates . 



Connect icu t . Mr. James S. LeSure, Director of the Connecticut 
Teacher Certification Department, participated in the client conference 
and indicated his enthusiasm for the program. Mr. LeSure feels that 
"Performance evaluation is the key to the problem of certification 
and professionalization of teaching." The METEP staff has remained 
in close contact with his department during the duration of the of 
the feasibility study and little, if any, difficulty is foreseen in 
the certification of METEP graduates. 

Massachu setts . The State Department of Education in Massachusetts 
has been contacted and it*s reactions to the model were favorable. 

A meeting was held in November, 1963 between James Cooper, Project 
Director and John P. McGrail, Director, Bureau of Teacher Certifi- 
cation and Placement. At the meeting, Mr. McGrail questioned cer- 
tain aspects of the program, but felt there would be no certification 
problem as long as the program met state requirements. Since that 
time the METEP staff has remained in close contact with the Depart- 
ment and their enthusiasm for the program has continued. Provision 
has been made in the model to meet the minimal requirements that 
were of earlier concern and we now have the full support of the 
Massachusetts Bureau of Teacher Certification. 
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Summ ary, The client acceptability study was designed to survey a small 
portion of the proposed future METEP clientele. The survey included 
a conference for twenty- three people of varied background, with each 
giving information on client acceptance via, a reaction panel, a 
questionnaire, and the Delphi Technique. 

The size of the surveyed group and the number of questions asked, 
has given us a sample of the public's opinion that we feel is largo 
enough to indicate the general likes and dislikes they have concern- 
ing METEP, All participants agreed that conventional methods of teacher 
education could be improved upon, and that the METED design seemed to 
be a well thought out alternative with great potential. The reaction 
panel and client questionnaire, combined with the indication of 
acceptance provided by the Delphi Technique leads us to believe that 
the general public will accord METEP its strong support in the years 
to come, 

The visits with certification departments in New York, Minnesota, 
California, Connecticut and Massachusetts indicated to us that METEP 
is compatible with the certification requirements of other states. 

It is interesting and encouraging to note that both New York and 
Minnesota are emphasizing the use of performance criteria in the 
future revision of their certification requirements. The absence of 
compatibility problems between out of state certification departments 
and the projected capabilities of METEP graduates, combined with the 
support of the Massachusetts Teacher Certification Department, gives 
us reason to believe that few future problems will be encountered in 
this area. 
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DELPHI FORM 



After you hnve answered these questions, please return the 
questionnaire in the envelope provided. Your expedience in the 
return of this information will bo most appreciated. 

In the following questions you will be asked to give your answer 
by checking a number from 0 to 100. In these cases ,, 0 M represents 
complete unacceptability and "100” will represent complete acceptabil- 
ity. 

1. If acceptability could be placed on a scale from zero to 
one hundred, the general public would rate METEP as: 
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2. If acceptability could be placed on a scale from zero to one 
hundred , the general public would rate conventional teacher 
tralnin g technique s as : 
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3. The teachers now teaching in public elementary schools would 
rate UETEP as: 
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The teachers now teaching in public elementary schools would 
rate conv enti onal te a cher traini ng techn iques ns : 
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5. The administrators hiring teachers for elementary teaching 
positions would rate the teachers graduating from METEP as: 
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6. The administrators hiring teachers for elementary teaching 

positions would rate the teachers graduating from conventio nal 
teacher trai n i ng institutions as : 
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7. Assuming that a teacher graduating from an average school of 

education would rate 50 in overall ability on a 100 point scale, 
where would a student graduating from MET15P he rated by the public? 
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8. How many years will it take for the METEP approach to become 
accepted as a valid method for training teachers? 

0 JLO 20 30 40 50 60 70 80 90 100 



In the next two questions, the numerals 0 to 100 represent 
numbers of parents. 

9. Out of 100 parents, how many see a need for elementary teachers 
with better training than they are now receiving? 

0 10 20 30 40 50 60 70 80 90 100 

10. Of these same 100 parents, how many would see METEP as an 
effective improvement over standard training methods? 

0 10 20 30 40 50 60 70 80 90 100 
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SCHOOL OF EDUCATION 

July 36, 1969 



Dear Sir: 

The enclosed Model Elementary Teacher Education Program (METEP) 
report should give you a fairly complete idea of the direction 
we are heading in our future planning. This report was sent to 
the U.S. Office of Education in May of 1968 and was one of eight 
in the nation funded to develop Phase II which is a feasibility 
study. During the past four months of Phase II, much of what is 
written in this report has changed dramatically, but the perfor- 
mance based philosophy has remained constant. 

Mr. Don Waldera, as I mentioned in my first letter, will be 
stopping to see you on August 1 to discuss these and other ques- 
tions related to your state certification requirements. It is 
through this meeting that we would like, to determine If there 
are any major certification problems to be overcome during our 
Phase II feasibility study. 

As you read sections of the report, would you consider some of 
the following questions in light of your state's teacher certifica- 
tion requirements. 

1. Are elementary teacher certification requirements in 
your state flexible enough to allow for graduates that 
have met specific performance levels, rather than 
credit hour requirements? 

2. Since there are variable entry and exit points in the 
METEP, the time spent v?ithin the system will vary 

from student to student. Do you foresee any difficulty 
certifying a student that spends only two and a half 
years in the system or one that graduates after five and 
a half years? 

3. Do you foresee any difficulties arising for local school 
systems if teachers are trained according to performance 
criteria? 

4. What are some of the performance standard? students 
must meet to be certified in your state? 
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Page 2 

July 16, ] 969 



Thank y.. e for consider ing these questions, we will he looking 
forward to discussing them wi th you. 

Sincerely , 



James H. Cooper 

Director of Teacher Education 
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INSERVICli DESIGN 



Tho inservicc design holds the key to several problems univer- 
sities have had for many years* The problems v;e speak of are: the 

lack of systematic communication with local school districts, the 
inability of universities to fulfill their inservice training 
obligation to local school districts; and the powcrlessncss of 
universities to facilitate meaningful change in public school 
systems. These problems will find either partial or complete 
solutions in the proposed inscrvi.ee design. 

The Survey. Prior to the development of this design, a survey was 
conducted by the University of Massachusetts 1 Center for the Study 
of Educational Innovations (CSEI). This center is located in the 
School of Education, and is primarily interested in helping school 
systems implement educational innovations. As a result of this 
interest, the center has spent a great deal of tine assessing the 
needs of public schools through contact with students and teachers. 
It was because of this interest in needs assessment, that the 
center was called upon by METEP to assist in determining the 
inservicc needs of Massachusetts teachers. The results of that 
survey are included hero, and have been used in tho formation of 
the inservicc component, (See Appendix A for complete survey.) 

The purpose of the survey vac to determine the invervSro npi*«iQ 
of public school teachers in Massachusetts. Eight thousand 
questionnaires were distributed to elementary and secondary teachers 
throughout the Comonwealth with a total of 2,850 returned. The 
response by elementary teachers, pre-school through grade 6, was 
1,348 or 472 of the total response. 

Respondents were asked to indicate their needs for inservice 
training in seventeen general subject areas that were dividjd into 
descriptive, sub-cntogoi ies . Teacher responses to the items included 
In the questionnaire suggests that the first priority of inservicc 
education is the establishment of workshops, seminars, and programs 
designed to advance t lie teachers 1 skills in understanding and 
utilizing knowledge in psychology and human relations, as it relates 
to individualizing educational programs. In the same vein, the 
survey indicated that for inservice education to be Meaningful, 
the emphasis must shift from a subject matter orientation to an 
emphasis on learning theory and the skills needed to cope with the 
varied characteristics of learners. These teacher needs, and other 
uncovered by the survey, form the framework for the inservicc 
design . 



554 



O 

ERIC 



The Design i The insovvicc design provides the opportunity for 
continuous personal growth through the completion of performance 
objectives and the chance for professional career growth through 
formation of a differentiated staff structure. The design has 
three major strengths, 

1. School systems participating in thin program will be 
committing themselves to a change, in present staffing 
patterns that will have positive and Jong range effects 
on the structure of public school education* 

2. A comprehonsi ve student Leaching experience ties in 
closely with the inservice design, and allows teachers 
an uninterrupted progression from pre-service education 
to inservice education via performance criteria. 

3. The design provides teachers with inservice assistance 
and instruction, both at the University during the summer, 
and at the teacher's school during the academic year. 

As ve have mentioned, the MhTKP inscrvico program requires 
a commitment from both the teacher and his school system toward 
di f ferentia ted staff development. U v . re making this request beenus 
v:e feel that significant strides Iowa ^ changing system staffing 
patterns must be made if personnel in education arc to be used to 
their full potential. Om commitment toward different Jared staffing 
patterns has been given statewide support by tnc Massachusetts 
Advisory Council on Education (MACE) , which was formed in 1963 to 
study the state's public education system and make recommendations 
cn its improvement. To quote fro.:- the MACE report, "New staffing 
patterns fot* elementary and secondary schools should be developed 
that nuke full and appropriate use of various kinds of educational 
specialists, professional personnel, beginning or associate teachers 
interns in training and para-professional workers." ihe METE? 
design will act upon this suggestion by assisting school districts 
in the training of their teachers to meet the challenges of new 
staffing patterns. 

Realizing that this type of commitment necessitates advance 
planning by school administrators, the HKYF.P staff contacted five 
school districts to explain the design and .ask for suggest ions , 

The five western Massachusetts school districts confirmed their 



Massachusetts Advisory Council on Education, 
i float ion a nd P reparation i n Ma ssachusetts , Boston: 
p. 46. 
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interest in this design and provided MKTEP with letters of intent 
to participate. (See Appendix B.) 

The inservice program will operate in the following manner. 
Teachers \:ill attend the University for six wricks during the summer 
where they will perform two rules: one as a student, and the other 

as an assistant instructor. As a student, the teacher will develop 
skills in observational techniques, supervision, and clinical 
procedures such as microteachiug and strength straining. Emphasis 
will also be placed on the utilization of additional staff in the 
classroom, i.e., large and small group instruction, seminars, 
tutoring, etc. As students, the teachers will also meet performance 
criteria in subject areas such as math, human relations, and 
language arts. The areas and depth of each experience will vary 
according to the needs profile of individual teachers. 

As assistant instructors, the teachers v;i]J work with MET IT 
undergraduates preparing them for internships during the following 
school year. All teachers rill he assigned four interns to v?ork 
with during the summer, and these same students will be assigned 
to them during the undergraduate's internship--t*wo interns each 
semester. Teachers and interns willspcnd approximately two hours 
a day together in seminars and micro- teaching clinics. During tills 
time teachers will be able to familiarize the interns with the 
cooperating school and its philosophy in a way that lias not been 
possible before. 

Both the teachers and undergraduates will find that this design 
allows a smooth and logical progression from performance criteria 
completed at the university to those they will work on in the class- 
room. Dr. Kevin Ryan, Director of the MAT program at the University 
of Chicago refers to the problem of transition in his paper n A New 
Start For Teachers 11 when he says, "Right now the major problem in 
teacher education is how to bridge the gap between formal university 
work in education and skilled performance, in the classroom 91 .* Hie 
procedure of bringing classroom teachers and interns together during 
the summer will do much to eliminate the coordination problem Dr. 
Ryan writes about. This partnership in the training of interns 
will also help to increase the communication between the University 
and local school districts. 
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After the inscrvi.cc toucher completes his summer at the 
University, he will return tu his .school with new ski].. It; in subject 
matter areas, and evaluation procedures as well as background on 
the development of :i differentiated staff* The two interns the 
cooperatin'; teacher will have in his room will act: as the core fiom 
which a differentiated staff will grow. As soon as the classroom 
teacher is equipped to handle additional personnel in the room, 
aides v.’ill he supplied by the. school district to continue the staff 
differentiation. A University resource that viJl be available to 
assist schools in the iriplo, mentation of differentiated staff ing 
is the More Effective School Personnel Utilisation tank force. (KlhSkU) . 
M1JSPU is centered at the School of Education as a branch of the 
Bureau of Education Processions Development of USOli and will provide 
valuable resources, both luunm and waleriuJ , for efforts in differ- 
entiated staffing. 



For school systems that commit twenty-five or more teachers 
to this program, on site in service visits will be made. This on 
site inservice program w i J 1 include workshops in human relations, 
ways of individualizing instruction, and specific: subject natter 
areas; assistance with staff development; and individual guidance in 
planning and meeting performance criteria* Also at the disposal of 
the schools will be all the materials produced by HLTEP for its under- 
graduate teacher education urogram. Of specific interest to insc.rvice 
teachers will he the hUiLe/iials «hw«npe.d In li*.*ni»ng leueiy, v.ays of 
diagnosing student problems, and individual ifciug instruction* s thor 
resources such ns videotape equipment, evaluation materials, etc., 
will bo made, available during the year for use by in Loros and co- 
operating teachers* 



Let us sun up the advantages of the J5ETEP design to interns, 
insorvi.ee teachers, and cooperating school systems. 

IjUe^nis. Continuity is provided for the interns between the perform- 
ance criteria he ha:* been working on at the University and those he 
will be expected to natter in Lite classroom. 

All interns will work with cooperating teachers who have know- 
ledge of their performance capabilities. 

Interns will have an opportunity to ? ^et ami learn from their 
cooperating teachers during the summer. 

Because Lwo inteins will be assigned to each teacher, they will 
have the advantage of peer learning. 
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Jnscrvicc Teachers . The inservfco Lonelier will receive an attrac- 
tive stipend as an assistant instructor during ?: is summer session at 
the University, and will receive free tuition for graduate t^ork 
during the year. 

The teacher will obtain continuous in service training in areas 
of his need, as v’ell as assistance in perfecting his role within a 
different! a ted staff . 

Teachers will gain the opportunity to move ahead professionally 
within the classroom due to the move toward differentiated staffing. 



C^jonratiji^ ScJif.oJ s. The skills and materials to help the schools 
move toward innovative staffing patterns will be available at a 
minimum c x p cn s e . 

The system's quality teachers will have the opportunity to re- 
main in the classroom rather than he promoted out in order to con- 
tinue their professional growth* 

The student-adult ratio will be improved because of the move 
toward differentiated staffing, resulting in improved learning op- 
portunities for children. 



o chouls Will have a q un lit y 
filiation with K1TIT.P, 
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Implements tl on . The implementation of the inscrvice program will 
follow the steps outlined in Figure 1. Although these activities are 
linearly presented, the last step, "update inservice program," im- 
plies the necessary repetition of many of the listed activities. 



Summary . The HCTEP design will provide the inservicc teacher with 
on site as well as University instruction in areas of the teachers 1 
need. To complement this instruction, the JXTEP staff will be 
working with the teacher's school district to implement changes 
in the traditional staffing patterns that have become stifling to 
professional growth within the classroom. This design also improves 
t lie present student leaching procedures so that a smooth and logical 
step may be made from the University to the classroom. It is our 
conviction that this concentrated tlitec-pronged attack will foim a 
broad groundwork for future changes within the public school systems* 
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TEACHERS : DATA SOURCE FOR DETERMINING IN-SERVICE EDUCATION PROGRAMS 



by 

David P. Crandall 
Richard Holzman 
Robert Sinclair 



A Survey Conducted 
by 

The Center for the Study of Educational Innovations 




November, 1960 



Introduction . Education is experiencing an unprecedented period of 
I'eform. Never before have there existed so many new programs from which 
educators may choose. However, only a few teachers have received adequate 
in-service education to prepare them for t ho many options for change. Be- 
cause of their responsibilities for instruction, teachers have little op- 
portunity, time or energy to develop skills appropriate for implementing 
the new solutions to the persistent problems of education. In fact, 
teachers often find themselves running just to keep up with the many 
changes. The present study centers on determining what in-service edu- 
cation is perceived by teachers to be most important for improving school- 
ing. 



Purpose of the Surve y. The purpose of this survey was to determine the 
needs for in-service education for public school teachers in Massachusetts. 
Hie investigator sought to identify perceived curricular and instructional 
needs of selected teachers. Frequency tabulations of responses to each 
item were computed to determine teacher consensus toward needs in in- 
service education. Teachers responded to the items by designating if 
method, content, or method and content best represented their needs. 

One description of in-service needs is found in the perceptions of 
teachers who arc close to the problems associated with the educational 
programs of the schools. In this study, not all dimensions of in-service 
needs are considered. Rather, the variables selected for gaining teacher 
perceptions were those thought to reflect current curriculum movement 
and present instructional trends. 



Selection of the Sample . Eight thousand questionnaires wore distributed 
to elementary and secondary public school teachers throughout the Common 
wealth. The teachers participating in the survey were designated by 
superintendents from dcmograpiiical ly different school systems. Each 
superintendent was instructed to distribute the questionnaire randomly 
to teachers representative of the total system. The number of question- 
naires returned totaled 2,850. Following is a specific account of the 
educators responding to the questionnaire: 

Figure 1 

WHO WERE THE EDUCATORS MIO RESPONDED TO THE QUESTIONNAIRE? 



Teachers (2850) 


t of responses 


* of l( 


Pre-school and kindergarten 


58 


2 


Primary grades (1-3) 


628 


22 


Intermediate grades (4-6) 


662 


23 


Junior High School 


518 


18 


Senior High School 


015 


32 


No re spon sc 


60 
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School systems were selected on the basis of diverse demographic 
conditions so that a larger cross-section of schools would be character- 
ized. In this way it was possible to insure that teachers from varied 
school systems would report their perceived needs for in-service educa- 
tion. Hie teachers were selected randomly and results were generalized 
to the total sample. 



Interpre t ation of Dat a. Respondants were asked to indicate their needs 
for in-service training in seventeen general subject areas that were 
divided into descriptive sub-categories. Several interesting trends 
emerged from the data. The priority ranking of the general categories 
was as follows: 



Figure 2 



PRIORITY RANKING ACCORDING TO TOTAL RESPONSES 



1 . 


Psychology 


10. 


Curriculum 


2. 


Science 


11. 


Aesthetics 


3. 


Instruction 


12. 


Health and Physical 


4. 


Language Arts 




Education 


5. 


Mathematics 


13. 


International Ed. 


6. 


Media- -Educational 


14. 


Guidance 




Communication 


IS. 


Foreign Language 


7. 


Social Studios 


16. 


Vocational -Distributive 


8. 


Student -Centered Teaching 




Education 


9. 


Administration 


17. 


Early Childhood Ed. 



Hie frequency distribution of responses to t lie items in the survey 
revealed the teacher needs. Following is a report of the teacher response 
to all items included in the in-service questionnaire: 

Figure 3 



TEACHER RESPONSES 



Roth 





Method 


Content 


Method 6 
Content 


Mathematics 


Modern Mathematics 


235 


126 


554 


Algebra 


42 


46 


94 


Calculus 


28 


48 


65 


Programs for the Underachiever 


271 


91 


640 


Programs for the Gifted 


125 


108 


411 


Probability and Statistics 


15 


63 


81 


Others 


11 


1 1 


45 




5G5 





Method 


Content 


Both 

Method 8 
Content 


Science 


Modern Biology 


27 


69 


143 


Modern Chemistry 


18 


46 


84 


Modern Physics 


14 


43 


80 


Earth Science 


45 


92 


179 


Physical Science 


29 


66 


118 


General Science 


67 


96 


265 


Marine Biology 


24 


90 


121 


Laboratory Procedures 


68 


35 


158 


Programs for the Underachiever 


117 


62 


379 


j Programs for the Gifted 


102 


74 


327 


Creative Science Techniques 


150 


75 


358 


Conservation and Environmental 


Education 


38 


69 


183 


Others 


3 


9 


31 


Health and Physical Education 


Health Counseling for Nurses 


5 


8 


29 


Narcotics and Smoking Education 


49 


101 


290 


Sex Education 


125 


91 


482 


General Health Education 


54 


82 


224 


Physical Education 


51 


64 


185 


Outdoor Education 


41 


68 


150 


Others 


6 


5 


24 



Psychology 



Educating the Underachiever 


246 


127 


599 


Educating the Gifted Student 


147 


87 


375 


Child Psychology 


49 


114 


158 


Teaching the Retarded Student 


62 


48 


182 


Sensory-Motor Perception 


50 


73 


270 


The Emotionally Disturbed Child 


155 


108 


454 


Human Relations in the Classroom 


145 


175 


506 


Others 


12 


7 


47 


Guidance 


Methods and Techniques of Testing 


49 


43 


127 


Vocational 8 Academic Counseling 


61 


64 


157 


Human Relations 


57 


62 


184 


Others 


50 


76 


147 


Social Studies 


The New Curricula 


59 


166 


370 


Civilizations of Asia 


14 


121 


111 


Civilizations of Africa 


15 


133 


149 


Black History in the Social 


Studies Curriculum 


16 


152 


254 
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Method 


Content 


Doth 

Method 8 
Content 


Social Studies (continued) 
Anthropology 


14 


118 


141 


Sociology 


25 


93 


125 


Programs for the Underachiever 


93 


75 


369 


Programs for the Gifted 


68 


68 


262 


Others 


4 


10 


34 


International Education 

Civilizations of Asia 


12 


108 


80 


Civilizations of Africa 


15 


109 


77 


Civilizations of Latin America 


18 


109 


84 


Teaching International Relations 


47 


86 


165 


Problems in the Developing 
Societies 


18 


71 


112 


Teacher- student. Exchange 
Programs 


40 


70 


93 


Programs in Cross-cultural 
Immersion 


25 


49 


101 


Others 


1 


4 


3 


Aesthetics 

Arts as the Focal Point of a 
Curriculum 


19 


49 


113 


An Integrated Arts Curriculum 


41 


65 


206 


Aesthetics and the Rational 
Curriculum 


.8 


37 


58 


Self-expression and Understanding 
Through the Non-Verbal Arts 


45 


77 


218 


New Techniques for Teaching the 
Arts: Music, Art, Dance 

Dramatics 


84 


62 


270 


Daily Use of the Arts by the 

Elementary Classroom Teacher 


113 


111 


484 


Others 


4 


4 


24 



Language Arts 



Written Composition 


165 


92 


436 


Linguistics 


71 


118 


382 


Speech Correction 


87 


44 


187 


Grammar 


96 


72 


236 


Fundamentals of Teaching Reading 
Severe Reading Problems 
Programs for the Underachiever 


153 


89 


616 


Programs for the Gifted 


90 


96 


419 


Others 


8 


7 


41 
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Both 

Method 8 

Method Content Content 



Foreign Language s 

Tlie Physiology and Psychology of 



Language Learning 


21 


46 


76 


Analyzing and Teaching in Cross- 








cultural Concepts 


11 


23 


63 


Teaching of Foreign Literature 


34 


27 


80 


New Curricular Developments 


30 


54 


104 


Materials and Equipment Testing 


35 


24 


87 


Romance Languages 

Others High on Creative Methods 


19 


38 


73 


and Technique of Teaching 


5 


9 


22 


Instruction 








Classroom 








Management Problems 


230 


83 


313 


Classroom Creativity 


248 


188 


599 


Orientation for Beginning Teachers 


103 


78 


247 


Individualized Instruction 


226 


85 


466 


Others 


119 


271 


396 


Curriculum 








The Teacher's Role in Curriculum 








Development 


58 


319 


257 


Current Theories of Learning 
Examination of Recent Changes 


31 


204 


1 A A 
in 


in State Curricula 








Federal Programs, Current Trends 








and Effect on Curriculum 
Development 


42 


238 


217 


■Pre-School and Kindergarten 








Programs 


15 


58 


168 


Developing an Emotionally Based 








Curriculum 


37 


108 


196 


Others 


8 


4 


22 


Student Centered Teaching 








Using Students as Teacher 








Assistants 


273 


108 


294 


Improving Student Government 
The Use of Learning Contracts 


61 


45 


84 


and Learning Interviews 


52 


44 


84 


Developing Learner Initiatives 


166 


78 


260 


Group Problem-Solving Skills 
Student Planned and Administered 


123 


72 


229 


Curricular Programs 


49 


40 


131 


In-School and Inter-school 








Student Tutoring 


83 


53 


139 
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Student Centered Teaching (continued) 


Method 


Content 


Both 

Method 6 
Content 


Student evaluation of the Teaching- 
Learning Process 


88 


79 


165 


Others 


3 


3 


11 


Early Childhood Education 

Child Development including 
History, Research and 
Current Trends in Cur- 
riculum Development 


31 


100 


131 


Restructuring Kindergarten 
Programs 


18 


55 


147 


Others 


1 


4 


12 


Media-Educational Communications 

Systems Applications in Education 


32 


64 


114 


Computer Assisted Instruction 


62 


91 


230 


Information Systems for Indivi- 
dualized Instruction 


45 


.103 


214 


Creative Approaches for Librarians 
and Audio-Visual Coordinators 


27 


48 


109 


Fundamentals of Media 


30 


79 


127 


Use of Multi-media Approaches 
in the Classroom 


193 


142 


456 


The Art of Film 


47 


74 


155 


Using the Computer for School 
Management 


50 


51 


85 


Vocational Training on the 
Computer 


26 


31 


10C 


Computer Use in Accounting, Mathe- 
matics, and Science 


34 


49 


179 


Others 


1 


5 


13 


Vocational -Distributive Education 

Current Trends and New Concepts 


31 


77 


137 


Systems Application of Work-Study 
Programs 


42 


48 


122 


Industrial Arts 


11 


24 


71 


New Careers--a New Concept in 
Adult Education 


16 


64 


113 


Others 


2 


10 


32 


Administration 

Developing a Flexible Schedule 


120 


107 


302 


Preparing Departmental Budgets 


65 


70 


147 


Problems of Administration 


42 


109 


175 


Acquisition and Use of Federal 
Funds 


69 


108 


184 


School Plant Planning 


23 


55 


95 
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Administration (continued) 

Organization and Administration 


Method 


Content 


Both 

Method d 
Content 


of Work- Study Programs 


31 


52 


128 


Public School Law 

The Use of Microtcaching to Improve 


26 


160 


145 


Teaching Performance 


53 


63 


193 


Systems Applications to Education 


2 


10 


32 


Management Decision-Making 
Implementing a Differentiated 


3 


3 


11 


Teaching Staff 


7 


17 


52 



Major results of the frequency tabulations show that teachers 
desire in-service training in modern mathematics and perceive the need 
for continued attention to be given to helping teachers with creative 
ways to teach science. In the Health and Physical Education category, 
a consensus was expressed toward providing in-service programs in sex 
education. Also, attention should be given to the topics of narcotics 
and smoking. The school is accepting larger responsibility in these 
important and controversial areas and teachers need supporting services 
to prepare them for coping with t lie complexities of such compelling 
topics. The major category of Psychology received more attention than 
any other dimension. It is here that the item of educating the under- 
achiever received a significant response. The need for in-sc-rvicc to 
center on the emotionally disturbed chi 1 d was expressed. Further, a 
large number of teachers thought it was important to consider human 
relations in the classroom. 

The tabulations suggest that teachers need in-service help in 
the new social studies curriculum and they desire training in black 
history as part of the social studies curriculum. The arts wore a 
concern of the teachers. Specifically the respondents expressed in- 
terest in an integrated arts curriculum and the understanding and 
expression of self through the use of non-verbal art media. Teachers 
perceived a need for in-service help in new teaching techniques for 
music, art, dance, and dramatics. Elementary teachers desire supporting 
services related to the daily use of the arts in the classroom. Writ- 
ten composition and linguistics were high priorities in the Language 
Arts category. Again, there was an expressed need for assistance in 
programs for the gifted and underachiever. Programs for the latter 
were perceived to be most important by the respondents. 

The categories of Instruction and Curriculum received considerable 
attention. All items under instruction represented priority needs for 
teachers. Programs in individualized instruction and creative class- 
room teaching were most in demand. A significant number of additional 
instructional needs were also expressed. Teachers desire in-service 



training in the diagnosis of learning problems, the prescription of 
learning opportunities appropriate for each individual learner, and 
the evaluation of student progress. 

The teachers reported a need to consider the teacher's role in 
curriculum development. They were particularly interested in determin- 
ing what content is included in the curriculum. Interest in recent 
changes in state-developed curricula was non-cxistcnt • 

Group problem-solving skills, student initiated learning, and 
students serving in a teaching role arc the priority in-service needs 
in the category of Studeni Centered Teaching. When considering the use 
of media for learning, the teachers were interested most in computer 
assisted instruction and the use of multi-media approaches in the 
classroom. Responses in the final category of Administration reveal 
that there is a perccrved need for in-service programs in flexible 
scheduling and micro- teaching to improve the effectiveness of teaching 
performance, 



Summary . The scores attached to these topics suggests that teachers 
consider in-service education aimed at the learning process to be a 
priority. Further, the responses stress the importance of instruction 
reaching all children. There was a significant emphasis placed on 
educating the underachiever and the gifted student. This priority was 
represented throughout the subject matter categories of Matlvcmat ics , 
Science, Social Studies, and Language Arts. The consistent emphasis 
placed on the underachiever and the gifted student suggests that it 
is one of the most critical problems co be included in in-service pro- 
grams. The ^identification of this problem points to the need for in- 
service education that centers on the diagnosis of individual learning 
problems and the prescription of alternative learning opportunities . 

In other words, the universities should provide experiences for tea- 
chers to become skillful in individualizing instruction and capable 
of reaching all students no matter what the nature of the pupil popu- 
lation in the classroom. 



It seems that the sampled teachers perceived themselves as being 
more knowledgeable and capable in the subject matter areas than they 
are in coping with the varied characteristics of learners. The sug- 
gestion that for in-service education to be meaningful the emphasis 
must shift from being solely on teaching to an emphasis on learning 
seems to be confirmed by our survey. Despite the continuing importance 
of solid grounding in subject matter, the institutions charged with the 
training of teachers must attend to the compelling need for in-service 
programs that concentrate on understanding the learner and the teacher’s 
relationship to individual students. 

In a general way, the teacher responses to the items included in 
the seventeen categories of the questionnaire suggest that the first 
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priority of in-service education is the establishment of workshops, 
seminars, and programs designed to advance the teachers' skills in 
understanding and utilizing knowledge in psychology and human rela- 
tions as it relates vo individualizing educational programs. Teachers 
currently do not have a repertoire of these complex instructional 
skills. The institutions of higher education must now provide pro- 
grams for coping with this expressed need for sensitive and conscious 
teaching. If the. institutions do not respond, they will continue to 
produce teachers who are outdated before they enter the classroom. 
Further, the many teachers who face the day to day jobs of schooling 
will be forced to rely on ineffective means for providing learning 
for all students. 
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SCHOOL OF EDUCATION 

October 25, 1968 



Dear Colleague: 

The newly established Center for the Study of Innovations in 
Education at the School of Education is conducting a state survey 
of teacher in-service needs. This questionnaire is the major part 
of the survey and the data collected will insure that workshops and 
in-service activities are directly related to your perceived needs, 



Your responses will be tabulated by computer and compiled with the 
Information received from others within the state, The resulting 
data will be of value in the present planning and future operation 
of a local and regional network of in-service programs offered by 
the School of Education, The findings of this survey will be made 
available to you in a report that will be sent to your district at 
a future date. 

We would appreciate it If you would complete this questionnaire and 
return It in the postage-paid reply envelope provided for your con- 
venience by December 1, 1968. 

If we can be of assistance to you In your professional work, please 
do not hesitate to contact Dr. Robert Sinclair, Director of the 
Center for the Study of Innovations in Education, at the School of 
Education. Thank you for your cooperation. 




Dean 



DWA: nak 




INSTRUCTIONS: 



PIc*»e answer all questions by checking the appropriate box and by filling 
in Information where Indicated. 

I, At what school level die you presently teaching* 



Pre-school b Kindergarten 


1 . 1 


Prlma ry grades 1 1 * M 


1.2 


intermediate grades (4-6) 


1. 3 


Junior high school 


1.4 


Senior high school 


l. 5 


Number of years of teaching experience’ 
1 . \ 


4-10 


C. 1 
2 


11 • 20 


2 3 


21 • 35 


2. 4 


Over 35 


2. 5 


Degrees held: 


Normal school diploma 


3. 1 


Bachelor's 


* 3.2 


Master's 


3. 3 


Doctorate 


3.4 


Other s 


3.5 



4 . Under the general headings below are listed areas which might je of interest to you (rnalhcma lie s, 
science, health and physical education, psychology, guidance, social studies, international cduca* 
lion, aesthetics, language a rts, foreign languages, instruction, curriculum, student c ente red 
teaching, early childhood education, media 'educational comrnunica tions, vocational education, 
administration). Please indicate any specific areas that interest you, including the relevant grade 
levels, by placing an "M" w-ilhln the brackets if you are interested in the instruction emphasising 
methodology and "C" if you wdsh that the instruction focus upon new content. Place "MC" if you 
would like the instruclior to emphasise both. If you would like to suggest a workshop in an area 
not listed, please write in your suggestion and indicate the appropriate grade l^vel. 



Mathcmitioj 

Modern Maths mi tier 


4. 1 


Elementary 

School 

( j 


Jo nior 
High 
School 

[ ; 


Se nior 
High 
School 

f ] 


Affine Geometry 


4. 2 


( 1 


[ ] 


[ ] 


Algebra 


4. 3 


( 1 


[ ] 


1 ) 


Calculus 


4. < 


( ] 


[ ) 


| ) 


Progiams for the Underachiever 


4. 5 


[ ) 


[ ] 


( J 


Programs for the Gifted 


4.6 


[ ] 


[ ] 


( ) 


Probability and Statistics 


4. 7 


[ ) 


[ ] 


( } 


Others 


4. 8 


l ) 


( ) 


[ } 


Science 

Modern Biology 


4,9 


( ) 


( ) 


[ 1 


Modern Chemistry 


4. 10 


[ ) 


( ) 


[ 1 


Modern Physics 


4. M 


( 1 


( ) 


( 1 


Earth Science 


4,12 


[ ) 


( ) 


[ 1 


Physical Science 


4, 13 




[ ) 


[ 1 


General Science 


4. 14 


[ { 


( 1 


[ 1 


Marine Biology 


4.15 


[ ) 


l ) 




Laboratory Procedures 


4. 16 


[ 1 


{ l 


( ) 


Programs for the Underachiever 


4. 17 


[ 1 


( ) 


r i 


Programs for the Gifted 


4. 18 


[ 1 


( ) 


( ) 


Creative Science Techniques 


4. 19 


[ 1 


i ) 


[ ) 


Conservation and Environmental 
Education 


4. 20 


( 1 


( ) 


[ i 


Others 


4. 21 


[ 1 


l ) 


\ ) 


Health and Physical Education 

Health Counseling for Nurses 

Narcotics and Smoking Education 

Sex Education 

General Health Education 

Physical Education 

Outdoor Education 

Others 


« 4.22 

4. 

4. 24 

4 25 
4.:<i 
4. 27 
- 4. 28 


I 1 

f ) 

( 1 
( ] 
f ) 


[ ) 
[ ] 
[ ] 
( ) 
[ ) 
[ ) 
[ ) 


( i 
( ] 
f ) 
i ) 
i i 
f ] 
\ ) 
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Pi)thoj og y 

Educating the Underachiever 
Educating the Gift id Student 
Child Psychology 
Teaching t)? <■ Retarded Student 
Sensory-Motar Perception 
The Emotionally Disturbed Child 
Human Relation* in the Cli i s room 

Other » 

Cuidanc e 

Methods and Technique! of Testing 
Vocational and Academic Countering 
Human Rela tiens 
Othe r s 

Social S tudies 

The New Curricula 
Civilizations of Asia 
Civilizations of Africa 
BlacV History in the Social Studiea 
Cu rri culunt 
Anthropol ogy 
Sociology 

Programs for the Unde rachiever 
Programs for the Gifted 

Others 

International Edueati on 
Civilizations of Asia 
Civilizations of Africa 
Civilizations of Latin America 
Teaching Intc . 0 t tl: r>al Relations 
Problems in the Developing Societies 
Teacher-student Exchange Programs 
Programs in Cross-cultural Immersion 

Others __ 

A e sthetic t 

Arts as the Focal Point of a Curriculum 
An Integrated Arts Curriculum 
Aesthetics and the Rational Curriculum 
Self-expression and Understanding 
Through the Non-Verbal Arts 
Wew Techniques for Teaching the Arts: 
Music, Art, Dance, Dramatics 
Daily Use of the Arts by the Elementary 
Classroom Teacher 

Olhe rs ___ 

Language Arts 

Written Composition 
Linguistics 
Speech Correction 
Grammar 

Fundamentals of Teaching Reading 
Severe Reading Problems 
Programs for the Underachiever 
Programs for the Gifted 

Others __ 

Foreign Lang uages 

The Physiology and Psychology of 
Language Learning 
Analyzing and Teaching in Cross- 
cultural Concepts 
Teaching of Foreign Literature 
New Curricula r Developments 
Creative Methods and Techniques 
of Teaching 

Materials and Equipment Testing 
Romance Languages 
O th e r s 



4.29 


Element* ry 
School 

1 1 


Junto r 
High 
School 

l 1 


Senlo r 
High 
School 

[ 1 


4. 30 


f 1 


[ 1 


[ 1 


4. 31 


[ ) 


l 1 


{ 1 


4. 32 


( ) 


( 1 


I 1 


4.33 


l 1 


[ J 


f ) 


4 34 


I 1 


[ 1 


[ 1 


4. 35 


r i 


( 1 


1 1 


4. 36 


( i 


( 1 


[ 1 


4, 3? 


[ i 


[ ) 


I 1 


4. 38 


[ i 


[ 1 


( 1 


4. 39 


[ i 


( 1 


[ ] 


4. 40 


r i 


1 1 


[ ) 



4.41 


[ 1 


[ ] 


i i 


4.42 


( 1 


f r 


r ) 


4.43 


[ 1 


[ i 


( i 


4.44 


I 1 


[ i 


i i 


4. 45 


[ 1 


i i 


t i 


4.46 


[ 1 


[ i 


; i 


4.47 


[ 1 


( i 


[ i 


4. 48 


f J 


f l 


r i 


4.49 


( ) 


( i 


i ) 


4. 50 


[ J 


[ j 


[ i 


4. 51 


( 1 


[ ) 


r i 


4. 53 


I 1 


[ j 


f i 


4,53 


! ) 


r i 


[ ] 


4. 54 


\ 1 


[ i 


[ i 


4. 55 


[ ] 


[ ) 


[ ] 


4.56 


[ ] 


[ i 


[ ] 


4. 57 


[ ) 


[ i 


[ ) 


-1. 58 


[ ) 


[ i 


[ ] 


4.59 


[ 1 


i j 


i ) 


4 . 60 


I 1 


i ] 


[ ) 


4. 61 


* 1 


[ ] 


[ ) 


4.62 


[ 1 


[ i 


[ r 


4. 63 


l ) 


[ ) 


[ ) 


4,64 


1 1 


t ) 


[ i 


4. 65 


{ 1 


r ) 


f j 


4.66 


[ 1 


[ i 


[ ] 


4. 67 


[ 1 


[ ) 


i ) 


4. 68 


[ 1 


[ ) 


r ) 


4.69 


( 1 


[ ) 


[ i 


4. 70 


I 1 


t ) 


[ ) 


4. 71 


( 1 


f i 


[ ) 


4.7 1 


f I 


r ) 


[ ) 


4. 73 


( 1 


[ i 


[ ) 



4. 74 


[ 1 


( 1 


( 1 


4. 75 


[ 1 


[ ] 


i ] 


4.76 


[ ) 


( ) 


{ 1 


4.77 


[ 1 


! 1 


f 1 


4. 78 


[ 1 


[ 1 


[ ) 


4.79 


( 1 


[ 1 


[ ) 


4.80 


( 1 


1 ) 


f J 
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Instruction 

Methods of Confronting Classroom 

Management Problem* 4.B1 

Classroom Creativity 4.82 

Orientation for 13 eg inning Teachers 4.0) 

Individualized Instruction 4.84 

Others 4.85 



Cu r r iculvmi 

The Teacher's Role in Curriculum 

Dcvel opinent 4 .86 

Cur rent Thtorie s of Lear ning 4 ,87 

Examination of Recent Changes in 

Sta tv Cur ricula 4. B8 

Federal Programs, Cu rrent T rends 
and Effect on Curriculum 
Development 4. 89 

Pre-School and Kindergarten Programs 4.90 
Developing an Emotionally Rased 

Curriculum 4.91 

Othc rs 4.92 



Student Cen te red T e aching 

Using Students as Tcachc r Assi slants 4.93 

Improving Student Gove rnme nt 4.94 

The Use of Learning Contracts and 

Learning Interviews 4.9S 

Developing Learner Initiatives 4.96 

Group Problem -Solving Skills 4.9? 

Student Planned and Administered 

Curricular Programs 4.98 

In-school and Inter-school Student 

Tutoring 4.99 

Student Evaluation of the Teaching* 

Learning Proceed 4. 1 Oh 

Others __ 4.101 



Early Childliood Educatio n ' 



Child Development including History, 

Research, and Current Trends 
in Curriculum Development 4. 102 

Restructuring Kindergarten Programs 4. 103 

Othc r i 4.104 

M edia -Educa ti onal Commun i catlon s 

Systems Applications in Education 4. 105 

Computer Assisted Instruction 4. 106 

Information System? for Individualized 

Imtruc tion 4. 107 

Creative Approaches for Librarians 

and Audio-Visual Coordinators 4. 108 

Fundamentals of Media 4. 109 

Use of Multi-media Approaches in 

the Classroom 4.110 

The Art of Film 4.111 

Using the Computer for School 

Ma nagetnent 4. 1 1 2 

Vocational T raining on the Computer 4.113 

Computer U se in Accounting, Matne- 

matics, and Science 4.114 

Other* 4.115 



Junior Senior 
Elementary High High 

Scho ol School S cho'-l 



t 1 
( ) 
( i 



( i 
I ] 

l ] 

[ 1 
( 1 

I i 

[ l 

( 1 
i i 



( ] 
I ) 



POOR ORIGINAL COPY - BEST 
AVAILABLE AT TIME FILMED 
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Vocational - Distributive Education 




Elementary 

School 


Junior 

High 

School 


Senior 

High 

School 


Current Trenda and New Concepia 
Syalema Application of Work-Study 


4. 116 


( 1 


[ ) 


[ ) 


Programs 


4. 117 


1 ] 


[ ) 


[ ] 


Induatrial Arta 

New Carecra - a New Concept in 


4. 118 


I ] 


[ 1 


[ ) 


Adult Education 


4. 119 


[ ) 


[ ] 


[ ] 


Othe r a _ 
Adminlatra tion 


4. 1 20 


[ ) 


( 1 


( ) 


Developing a Flexible Schedule 


4. 121 


[ ) 


[ ) 


[ ) 


Preparing Departmental Budgcta 


4 122 


( 1 


[ 1 


I ) 


Problems of Administration 


4. 123 


f ) 


[ ] 


[ ) 


Acquisition and Use of Federal F unds 


4. 124 


[ 1 


[ ) 


[ ) 


School- Plant Planning 
Organization and Administration of 


4. 125 


( ) 


[ ) 


1 ] 


Work-Study Program* 


4. 126 


r ) 


( ) 


[ ) 


Public School Law 

The Uae of Microteaching to Improve 


4. 127 


[ ) 


I ) 


[ ) 


Teaching Performance 


4. 128 


[ i 


( ] 


[ ) 


Syatem Application* in Education 


4,129 


i i 


t ) 


t 1 


Management Decision-Making 
Implementing a Differentiated Teach- 


4. no 


i i 


[ ) 


I ) 


ing Staff 


4 . m 


f ) 


[ ) 


[ ) 


Other a 


4. 132 


t ) 


1 ) 


[ ) 



5. If the Center for lnnovationa were lo provide inaervice education oppor tunitie a for you on a 
regional basis, which suggested location would be moat convenient and what instruct! onaJ unit 
would you give highest priority? (Note: mark location by writing in the program priority; 
I.e. Modern Math next to Pittsfield, if that ia what you dcaire. 1 



Amherat 

Athol 

Bedford 

Boston 

Brookline 

Cambridge 

Fall River 

Falmouth 

Framingham^ 
Gardner 



Green/ield_ 

Holyoke 

l.awrence__ 

Lowell ____ 

Lynn 

M a l d e _ 

Manchea te r_ 
Needham __ 
New D ed ford 



New ion 

North Adaina_ 

Pitt* field 

Ouinry^ _ 

5alc.it 

Spring field 

Waltham 

Wore e s te r 



Other location not Hated: 



6. 


Are you now participating In college or university level studies? 




Yea 


6.1 [ ) 




No 


6.2 (] 




Unde rg raduate 


6.J [ ] 




Graduate 


6.4 ( ] 




Other* 


6.S [ ] 


7. 


Which day ia most convenient for 


you to participate in weekly workshops’ 




Monday 


7.1 [ ] 




Tuesday 


7.2 [ ] 




Wednesday 


l.l { ] 




Thursday 


7.4 [ ] 




Friday 


7.5 [ } 


8. 


What time ia convenient? (Check 


more than one if you wish. 1 




4 00 - 6:00 PM 


6.1 [ ] 




7:00 - 9:00 PM 


8.2 [ ] 




Other* 


8.1 [ ] 


9. 


If a workshop were scheduled for 
attend? 


a Saturday morning, from 9 00 to 1 1 00 , 




Yea 


9. 1 ( 1 




No 


9.2 t ] 



578 



O 

ERIC 



10. 


Would you participate in a t or 2*wce> 
in thr following area a 


fnten* i » 


;c rnacrvicc program during the aurr.mer 




Mic roicaching 


10 1 


I ) 




f lexible Scheduling 
Individualized 


10. 2 


r i 




Instruction 


10. 3 


r i 




Technol ogy 


10. 4 


[ ) 




E.lernentary Reading 


10. b 


r ) 




Secondary Reading 


10. i 


[ ) 




Other* 


10.7 


[ i 


II. 


If your answer to the previoui question 1* Y tj , 


, which monih mould be preferable? 




July 


11.1 


( 1 




Augua l 


11.2 


1 ) 


12. 


Would you be intcrened in attending I, 
arcaa during the school yrar^ 


2, or 3 day conferences in the following general 
1 Day 2 Pay 3 Hay 



Creativity in the Elementary Claaaroom 
Individual*? ed Zntlruction 
International Education 
Children with Learning Pi f abili lie • 

L 1 fban Educ a lion 
A« athc tie i 
T echr.ology 
Human Relation* 

Inttilutei for School ConmlSIce Member* 
Content Ar^ai (Picnic Specif)) 

Oihcta „ 



12.1 
12.2 
12. 3 
12.4 
12. S 
12.6 
12 . ? 
12 . 6 
12.9 
12 . *0 
KM? 



i 



( 



13. Given iU incentive* for j a i licipatir.g In an IraerWce prtgram, rar> according to Impor* 
lance your reaiom for enrollment* I. c. If pav increment ti the rr.o*l important reaic-n. 
rank it 1. Rank decteaiing level* of importance with 2, 3, 4, 3, and fc and 2, 

De air e to g row prof* Mionally 13,1 { 1 



College C r e dt t 
Certification Requirement i 
Revitalize tlon 
Pay inc r tmerl 
Pr emotion 

Oihe r a 



13.2 
13 I 
13.4 

13.3 
13.6 
13. ? 



( I 
( 1 



l . 

i ) 



I 4. Would you be inter e ale d it. aeivtr.g a i an In rt rue lor fer an Hie r rice v-orVaho^ 

Ye i 14.1 ( ] 

No 14.2 | ) 

Not lore 14.3 f j 



13. The Schccl of Education welcome* ary c '^rnrr.* nt* mMch you feel would be relevant In it* 
planning for the future. Kindly include #uch thought* at special problem# that the School 
of Education could help reiolve, Idcaa on hot In Improve education, and way* in which 
you feel ’hi* the Schncl of Education could join math you in puftairg educational improve* 
ment. 



16. Name and School Pii'rlct • If ye-a 
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Greenfield Public Schools 



GREENFIELD, MASSACHUSETTS 01)01 



Will (am R. Wrtght, Sup<rintcndtr>t 



August 6 , 1969 



Dr* Wt V, Fanslow 
School of Education 
University of Massachusetts 
Amherst* Massachusetts 

Deer Dr. Fanslow! 

This is to certify that the Greenfield Public Schools 
arc vitally interested in your proposed program of "Cooperative 
Teacher Trailing" and wholeheartedly endorses the project. 

Ve will be most happy to participate in the program 
will give complete cooperation and assistant* in insuring its 
success. 

If there is any further effort we can nake to insure that 
this project is funded, please let us know. Ve look upon the 
concept of the program as a truly forverd step in the prepara- 
tion of teachers for classroom duty* 



OrlthfptlJ Schocll 
Dtrtlof rht iVil'tf »o tMftt. 

Girt 1 'horoutH triimr ( fn fwMirvmil iViHi. 

Develop f^6d Klhitl, dfi'fibte itUtvde*, ltd ic jr»d chllrtet. 
Develop irvowledge tr>J vhdeiatirtdinf ft« the rovrutitr of «bt fupil petmlu. 



Sincerely, 




William R, Wright 
Superintendent 
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ASSISTANT flTF.nPNTENDENT 
Loui* ). IM.frt 
DIRECTORS 

CUKfit K, Vuncti » Mcilifmftfir* 
Jchn D. HtiMca ♦ SocW SiudiVi 
NfliBin C Nijiruy * 

^nat 11 Nfibil • 5rlfW« 



August 7* 19&9 



Dr. William Farslow, Director 
Teacher Training 
University of Massachusetts 
Amherst , Massachusetts 

Dear Dr. Fanslow: 

The Pittsfield Public Schools have long considered 
the desirability of improving the teacher-training ex- 
perience in our schools. An opportunity to cooperate 
more fully with the University of naseachus** ts <n train- 
ing personnel would certainly be welcome. Ve desperately 
need people who are equipped to handle a variety of assign- 
ments in the classroom in addition to staff people who have 
been trained to work with other professionals and para- 
professionals in the same classroom* Ke therefore request 
that the University of Massachusetts give serious con- 
sideration to the establishment of a Teacher Education Pro- 
gram which would better meet our needs while at the same 
time providing an opportinlty for a more meaningful learn- 
ing experience for student teachers and staff alike. 

Specifically, wc would heartily recommend a program 
containing these elements: 

1, Preparation for teacher training during the summer 
months which would concentrate on both the usual 
practicun components and whatever added subject 
matter instruction was deemed necessary* 
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- pace two - 

2. An opportunity for cooperating teachers from the 
Pittsfield Public Schools to attend the sane su;\rr or 
training session as supervisors and trainees of 
those wJ.th whom they would work during the following 
year* Cooperating teachers should be paid as well as 
given course benefits at the University. 

3. The cooperating teacher, in undertaking this assign- 
ment, would be obligated to accept the same four 
student teachers during the school year in some sort 
of differentiated staff organization. Cooperating 
teachers could work with two of these interns each 
semester , 

4. The Pittsfield Public Schools would be interested in 
sending fifteen to twenty teachers to the University 
for participation in such a program. 

The advantages to the Pittsfield Public Schools, were such 
a program funded, are many: 

1. Joint working and planning between cooperating 
teachers and practice teachers provides Krcalvi* 
opportunity for significant educational achievement 
during the school year. The cooperating teacher is 
afforded an opportunity to assess the strengths and 
weaknesses of the student teachers and to develop 
effective rapport. 

2. 1 think that such a cooperative venture will cer- 
tainly help to improve the prospective teacher's 
image of the school system in which he will gain 
his first practical experience and will hopefully 
increase the school's likelihood of attracting out- 
standing candidates. 

3. Pittsfield would be given the opportunity to explore 
the exciting possibilities offered by differentiate' 
staffing, This model night then be adopted in ot’^er 
classes and result in better staff utilization and 
improvement of the Instructional mode. 




Assistant Superintendent 
Curriculum Itevelepneht 



LJH/cdk 
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THE PUBLIC SCHOOLS of S P %l N GF I EI^D, MASSACHUSETTS 



John E. Deody, Superinlende nt 



Ctntrol Offic t 
195 Stale Street 

on 03 

August 12 , 1969 



Dr. Willie* B. Fans lev 
Director of Field Experience 
School of Education 
University of Massachusetts 
Amherst, Massachusetts 01002 

Dear Dr. Jbnalovi 

Thank you for sending ir» a copy of yr ir proposal to improve the teacher 
training program at the University o* Massachusetts. Reviewing it has 
confirmed ®y positive attitude towards the project which I discussed 
vith you last week. The problem of improving teacher training programs is a 
provocative one which has failed to receive sufficient amounts of critical 
analysis and creative thinking in the past, S believe yewr plan to 
train "Clinical Professors" to work in the training of prospective 
teachers prior to serving as their supervisors during the practicura will 
bring a continuity to the whole process which has been lacking in the past. 
It will lend status to teachers from our school system participating in 
the program, it will compensate them for their efforts, and the presence 
of two student teachers in the classroom each semester vith the supervisor 
will enable ui to experiment with various differentiated staffing 
techniques which can result in better educational opportunities lor 
students here in Springfield. 

We cosroend your efforts and look forward to cooperating vith you in the 
implementation of this proposal when it has been funded. 

SkicejceWs, av 

JCTOt e. DEAD* 

Superintendent of School. 



JED: Jf 
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CITY 



Dr. MirctUa R. Kelly, Superintendent 
HOLYOKB PUhUC SCHOOLS 
91 SUFFOLK SimT 

m yu-wt 




OF HOLYOKE 

MASSACHUSETTS 

Zip Cob 0104Q 



September 10, 1900 



Assistant Professor William V. Fanslow 
School of Education 
University of Massachusetts 
Amherst, Massachusetts 

Dear Professor Fanslow? 

You will be pleased to learn that at the September 15 meet- 
ing of the School Co>ftfnitteo the nine fner.be ts present voted unanimously 
to support and indorse your proposed Teacher Training Project in which 
the Public Schools of Holyoke would be a cooperating sponsor. 



MltKilb 



'ery truly yours, 



Mar Ac Ha R. Kelly 
Superintendent 
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SCHOOL ADMINISTRATION OFFICES 

CHESTNUT STREET 

AMHERST. MASSACHUSETTS 01002 



AuguS t 1 2, 196) 



Pi. blittiam fan if «o 
ScJwoC c$ Education 
((Huivistfi/ OjJ Moss. 

Am/ieASt, Mail. 01002 

Vena D-l. Ffliiifno: 

A ( oa-’i rcecftiig o,5 August Uth, the Aidie’iit-Pc Chew Regional. 
School Comittce niomboAs expressed interest in participating in 
tujdc.'uj’iaduate tcadic'i tiadu'iy jrunjMn afeng with the Univeuitij and 
(Joul other tehee? Aijitcrii. h’c will he gfad to help in p tie pa ung flu 
tf’PA pxepciat to Aceh the £undi (hat teoo.id be needed to initiate <sudi 
a p.’iog'iam. 




R onatd J. 'Fitzgerald 
Supexi ntendent SchcctA 



RJFipf 
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EVALUATION AND RESEARCH 



Introduction 



In tills section, a framework lor the evaluation and research 
components of METER will be outlined. However, it is not the 
purpose of this report to exhaustively cover all .aspects of the 
evaluation and researcli components. The purpose is to present an 
overview of the main stens and techniques to be used. And just as one 
should conceive of MLTEP as a flexible, ever-developing program, the 
evaluation and research components should be thought of in the same way. 
At the present moment, evaluation me thodology is emerging - as newer and 
better evaluation techniques are discovered our components will be 
modified accordingly. It is expected that this section of the report 
will serve as a 1 starting point 1 for the group charged with the respon- 
sibility of developing the research and evaluation methodology in Phase 
III of the project. 

Tiie role of the elementary school teacher is changing and will 
continue to change in the future. In order to answer tiie criticisms 
leveled at existing teacher training programs, educators are finding 
it necessary to devise radically new approaches and experiment with 
various innovations for training teachers. METKP is one of a few new 
models which purports to bring about the necessary changes in teacher- 
training programs. Evidence must be made evaj table to determine: if 
this is so. For this reason it is necessary to engage in evaluation 
studies. Certainly* any progress in education is dependent on effective 
evaluation. It would be foolish, to say the least, to implement 
innovations into teacher- training programs on a large scale basis 
without first empirically demonstrating their usefulness. At the same 
time, because so little is known about the variables instrumental in 
turning out good teachers, there is a heavy demand for basic research 
in the area of teacher- training. This point is made by Gage (1964) 
and others. 1 1 is expected that the researcli studies conducted within 
METEP will solve some of the current problems in teacher-training as 
well as problems related to other aspects of education vrhich exist 
today, 

One can argue, and rightly so, that every innovative project like 
METEP needs an evaluative component; if only because the government 
has invested a large sum of money in the project and deserves to see 
the results of their investment. In the case of ItETEP however, an 
effective evaluation takes on increased importance when one considers 
the implications. Pending the outcome of the evaluation are decisions 
which will affect the future development in the design and functioning 
of teacher-training programs* Thus it is imperative that every effort 
be made to evaluate JILTEP with the best techniques available, at all 
levels of operation and in every way possible* 
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Unfortunately, from the* point of view of the project director, 
evaluation methodology is only now being developed. This* of course, 
complicated the problem of doing an effective evaluation. A variety of 
evaluation models exist, designed for different purposes, each with 
certain advantages and disadvantages when appl ied to ItlsTLst* • These 
include models for Title 1 and TV projects and curriculum projects 
among others. Included among those who have directed attention to 
evaluation models have been Hastings (1966) , Wilhelms (1967), til con 
(1967), G1 asor (1967), Scriven (1967) and Stuffleboam (1966). Many 
of these models are at least partially useful for the evaluation of 
METER. Rather than adopt one model ns a guide, we have taken sugges- 
tions from a wide selection of writers , In some cases, because of con- 
flicting viewpoints, we have had to make certain decisions concerning 
our own evaluation model. 

Before describing the evaluation and research components for 
METER, it would be useful to backtrack and describe the purposes of 
evaluation and research in this project and also note U.c differences 
between the terms. According to Hemphill (1969), "In many instances, 
no distinctions are made between evaluation and research." Br.kei vi969) 
goes on, 

Although logically and perhaps semantical Jy , one can 
distinguish betv:een research and evaluation, it is not 
very useful to base that distinction on a review of 
literature dealing with curricujuw research end 
evaluation on the basis of the terms used by the authors 
in the titles and the operational definitions assigned to 
the terms in the articles is nearly impossible, 

In spite of the associated difficulties, we will attempt to make the 
distinction in METER. 

The purposes of evaluation in this project are lv;o-fold: first, 

it provides a way of making decisions concerning revision, refining, 
and discarding facilities, materials and methods. Scriven (1967) 
refers to this as "formative evaluation". Formative evaluation 
techniques are employed when one is interested in revising an ongoing 
project, On the basis of reliable and valid empirical evidence 
obtained by objective means (if possible) decisions arc mode to 
modify deficiencies in the program. Recently Scriven (1967) and 
Stake (1967) have argued that even some evaluators are capable of 
making objective value judgments, FormaLive evaluation leads to 
trial-revision cycle, 

The second purpose of evaluation is to determine the overall 
effectiveness of the project. Ibis kind of decision making is 
referred to by Scriven (1967^ as "summative evaluation". 
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Almost nil sununativc evaluation is comparative; however in some cases, 
it is simply a description of the outcomes of the project. It is 
note-worthy that not all evaluators are convinced of the usefulness of 
comparative studies. This point will be discussed in norc detail later. 

In differentiating between summativo and formative evaluations* Ahmann 
(19G7) made a point which is relevant here. lie said that the dis- 
tinction between summative and formative evaluation is less clear titan 
it appears to be. The distinction cannot usually be made until the 
use which is going to be made of the evaluation data, and by whom, 
is determined. 

Hie purpose of basic research in this project is to add to our 
knowledge of the practices and methods of education (Hemphill, 1969). 

In order that useful, genera livable research results be obtained, it 
is imperative that attention be given to the specification of treat- 
ments and experimental designs. 

In noting the differences between research and evaluation, 

Hemphill (1969) says, 

Evaluation differs from basic research in its 
orientation to a specific program rather than 
to variables common to mnuy urograms. The 
objective of educational rocoarcii is to gain 
general izablc knowledge about the practice of 
education; evaluation seeks to provide a basis 
for making decisions among alternatives. Thus, 
evaluation is concerned with questions of utility 
that involve value and judgment. 

Finally, it should be mentioned that it is expected that a wide 
variety of evaluative techniques and experimental designs will be 
used in the project. Obviously, no one technique and experimental design 
will be sufficiently useful to measure every objective of the program, 

For example, in the case of evaluative techniques, when ve are inter- 
ested in evaluating (summative evaluation) a multiple-choice test 
constructed by an instructor in the program, we will use the technique 
of item analysis. Whereas when we arc concerned with the attitudes 
of students in the program, vc will make use of questionnaire data. 

Hie remainder of this report is divided into six major sections. 

In the following section is a description of some of the data which 
will b i collected on the * indents entering and leaving the program 
upon graduation. The following sections describe the formative eval- 
uation, ive evaluation, and basic research components of METFP. 
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'a the final two scctio"*' of this report are short discussions of the 
purposes and composition of an evaluation and research committee, and 
some suggested procedures for disseminating information on the project. 
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Collection of Background Information 



In order to facilitate the evaluation (formative and sumip.ative) 
and the basic research, it will he necessary to administer a diverse 
battery of tests to students entering the program. The same battery 
of tests will also be administered to graduating students, To sup- 
plement tills, biographical and high school records o.i the students 
will be collected. For the purposes of comparison the same data will 
be collected on several other large groups of students in different 
universities. It will be useful, to know something about the com- 
patibility of the input and the output in different institutions, 

It would not be surprising for example to find differences in the 
groups on certain psychological variables such as risk-taking. A 
reasonable hr pothesis would be that students enrolling in an ex- 
perimental. program would be more likely to be high risk-takers than 
students enrolling in more conventional programs. 

The battery will include torts to measure intelligence and a 
variety of aptitude, achievement and personality variables, Tests 
to measure specific factors of intelligence vjill be chosen from 
Guilford's "Structure of Intel lect Model 11 (1956) and French's, et.al. , 
(1963), "Kit of Reference Tests for Cognitive Factors", Of partic- 
ular interest will be the tests measuring factors which have been 
hypothesized to predict success in teacher training programs (Gallagher, 
1968). These would Include tests measuring convergent thinking, diver- 
gent thinking, and evaluation factors in the contents dimension of the 
Guilford Model, 

The aptitude and achievement tests will come from at least two 
sources: the Differential Aptitude Test and the Frencn Kit of 

Reference Tests for Cognitive Factors. The battery of personality 
tests will include general anxiety (Taylor, 1953), test anxiety 
(Alpert and Haber, I960), need achievement (Atkinson and Feather, 1966) 
and risk-taking measures (Swineford, 1938, 1941; Slakter, 1969). Also 
measures of need-for affiliation and interpersonal attitudes will be 
obtained. Student responses to preference inventories, value inven- 
tories and interest profiles will be obtained. Two oilier tests which 
will be included in the battery as they have been found useful are 
the YJatsnn-Glaser Critical Thinking Appraisal Test (Yager, 1968) and 
the Minnesota Teacher Attitude Inventory (Yee, 1969). Finally, this 
list of variables will be modified by removing some tests and/or 
adding new tests as new theories are hypothesized and developed con- 
cerning teacher-training programs. 
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Formative Evaluation 



The purpose of formative evaluation will be to suggest improve- 
ments for the project while it is developing, Cronbach (1963), strong- 
ly advocated the use of evaluation in identifying aspects of the pro- 
gram which needed revision, while both Flanagan (1969) and S tuf flebeam 
(1966) indicated how much more effective formative is than summativc 
evaluation for improving education. In spite of this, Welch (1969) 
pointed out a potential problem. He said that the feedback process 
in stimulating changes in developmental projects had not hern exten- 
sively studied. Some of the problems with formative evaluations in- 
clude time-delays, inability of course instructors to incorporate 
suggested changes, and test items failing to measure what the instru- 
tors specifically wanted. The decision-making processes will be 
watched very carefully in this project. Controlling this situation 
will be a group of specially trained formative evaluators. However, 
the role of the group should be clearly understood - unlike the basic 
researchers - these people will not exercise any experimental control 
over the project, nor will they directly manipulate any part of FETEP, 

The formative evaluators will observe the workings of the project 
without intervening, or at least intervening as little as possible, 
Through their evaluations however, they will be able to instigate 
changes at periodic tines in the program. As Stufflebeam (1966) said 
in describing the formative evalualoi. 

He then "bugs" the situation as best he can by 
focusing his best observation and other non- 
interventionist data collection techniques on 
those aspects of the project which are most 
crucial to its success. The nature of such 
an evaluation is multivariate, and not all of 
the important variates can be specified prior 
to the initiation of a project. Consequently, 

(he) focuses on those variates which are 
theoretically important, but also remains alert 
to any unanticipated but significant events that 
may occur along the way. In summary, data are 
collected day by day, organized systematically, 
analyzed periodically, for example weekly and 
reported as often as the project director may 
require such information. 

The formative evaluators will use a variety of techniques. These 
techniques include (as summarized by Welch, 1969): Teacher reports 

(written and verbal), student Interviews and discussion, questionnaires, 
observations, test results, and outside professional views of produced 
materials. On the basis of frequent evaluation reports, the project 
director make decisions concerning the project and appropriate 

modifications. This cycle will be continuous throughout the duration 
of the program, 
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The formative evaluation will have its effect in many areas of 
the program. In this report, uc will limit, the discussion to sonic 
sped lie examples in the con ten L and the human relations areas. 

.ATil'liv To begin with, there exist many questions concerning 
the performance criteria and the instructional, alternatives. Can 
students learn to achieve the selected criteria by expevj cneing the 
available instructional alternatives? What percentage of students pass 
the test associated with each performance criterion ( i . e . , what is the 
difficulty level of each test)? Is this percentage the same for 
students who chose different instructional alternatives? Are there 
personality characteristics which typify student's who chose different 
instructional alternatives? Can some of the students pass some of the 
criteria without experiencing any instructional alternatives? Does 
success or failure under an instructional alternative have any effect 
on a student’s subsequent choice of instructional alternatives for 
other performance criteria? What is the cost of providing each in- 
structional alternative and is it. reasonable to provide such an 
alternative when only small numbers of students tube advantage of it? 

The answers to some of these questions will obviously lead to improve- 
ments in MGTJSP. Answers to other questions will suggest controlled 
research studies. 

In order to answer some of the questions raised above, it would 
be extremely useful to summarise the data on each performance c * i i i- j .lon 
in a two-way table with the rows of the table corresponding to the 
instructional alternatives and the columns to the possible outcomes 
(pass and fail) on the test associated with each performance criterion. 

A sample is presented in Table 1. Entries in Che table include the 
distribution of students across instructional alternatives, and the 
frequency and percentages with which students pass and fail the cri- 
terion test by choosing different instructional alternatives. Since 
the raw data (student outcomes on each performance criterion and choice 
of instructional alternatives) are available in the data bank, these 
tables can be readily produce! by the computer (at say, once every 
few months) to provide useful information for instructors and evaluators 
to make modifications. 

One responsibility of the evaluators will be to train the instruct- 
ors to interpret the computer output . The importance of this respon- 
sibility is magnified when one. considers the results of a study by 
Dick (1968). Dick studied the behavior of a group of instructors 
making modification to a programmed text by using different sets of 
information. Results showed that the group without proper guidance ns 
to which parts of the information were most useful consistently made 
use of the wrong information in making modifications. This study 
emphasized the importance of proper training for those modifying 
curricular materials. 
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SAMPLE DATA ON A TYPICAL PERFORMANCE CRITERION 
PERFORMANCE CRITERION ; 



Instructional 

Alternatives 



Outcome 



Sample Pass Fail 
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As a result of our feasibility testing it was found that in some 
content areas as many as 80% of the students preferred conventional 
lectures as opposed to other Instructional alternatives. Given that 
other instructional alternatives are more effective for promoting 
learning, at least for some students (Cronbach, 1967; Snow, 1969), 
then it is necessary to encourage students to show more variability in 
their choice of instructional alternatives. It lias been suggested 
that in the early stages of the progiam, students be forced to make 
use of different instructional alternatives. It is expected that early 
exposure to a variety of instructional alternative** will increase the 
liklihood of students choosing those strategies again. 

This same two~v;ay table described earlier will be extremely useful 
foi research in the areas of time studies and cost analysis. 

It will be important to take a close look at the performance 
criterion tests. In some cases, it will be possible only to estimate 
content validity. This will be done by obtaining opinions of content 
experts. In areas where multiple-choice tests are used, item analysis 
will be a useful evaluative tool. To increase the feasibility of this, 
tests will be answered on digitek sheets, processed through the digitek 
machine which in turn will return student response information punched 
on IBM computer cards. When sufficient numbers of cards are collected 
for each performance criterion a computer program will be used to carry 
out an item analysis. 

By continually modifying and testing out experimental items it 
will be possible to build item pools for the performance criteria 
which utilize multiple-choice tests. Since it would be unrealistic to 
use the same test repeatedly, the item pool will "acilitate the 
construction of alternative forms for each of the performance criterion 
tests. The work of Gorth e t. al « (1969a, 1969b) in the area of item 
sampling designs and tape-based data banks will be extremely useful 
here. 



Many evaluators have stressed the importance of evaluation 
beyond the simple analysis of pre-test and post-test scores. The 
additional data was stressed because in many comparative studies 
(comparative in the sense that post-test achievement scores 
were compared between students in an experimental program and a 
conventional program) , although teachers and students praised the 
new experimental technique, differences in post-test achievement 
scores between the experimental and control group were not usually 
obtained. Webb (1966) recommended hat additional useful information 
of perceptions of teachers and students regarding the learning process 
would be relevant. The technique of analyzing achievement scores, 
and teacher and student attitudes is referred to by some researchers 
as the triangulat ion px*ocedure. This is rapidly becoming a pew or fid tool 
in evaluation. This technique of evaluating each component of the 
program on three dimensions will be used where it is relevant. 
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Human Relations. Evaluation in the human relati ms component raises 
many new questions. First* however, it is necessary to review MKTEP f s 
goals in this area. METKP is interested in producing the fully lmimm 
teacher, a person who meets the hum-m criteria of warmth and human 
understanding, is capable of rigorous thinking, is in control of his 
own behavior, and is in a constant pattern of growth. Some of the 
questions which will arise in the developmental stage include: can a 

human relations program result in personal growth for the elementary 
teacher which is measurable? The question here is can we influence 
the day-to-day behavior of the student teacher in and out of the 
classroom through human relations training? How can we move from 
subjective evaluations to behavior counts of specific human relations 
acts? What behaviors are most relevant to teach the student teacher? 
Knowing that there exist individual differences in human relations 
skills, can a "behavioral diagnostic test" be developed which will 
identify the "best" way to proceed with each individual? What 
relationship does teaching human relations skills have with teaching 
material in other content domains? Answers to some of these questions 
will not only aid in the development of MKTEP but will provide 
information in an area which has not been extensively explored mainly 
because of the complex problems associated with this kind of research. 



Summative Evaluation 



In applying summative evaluation techniques we will be interested 
in making an overall evaluation of the project. Whereas formative 
evaluation will be most important in the first tv?o to three years of 
the project, the emphasis V7tll shift in the third year towards 
summative evaluations. 

Before going into the details of the summative evaluation 
techniques, two strategies of evaluation which have been frequently 
used deserve special attention. These are: the use of comparative 

experiments and global evaluations. Concerning the first, Weich(1969) 
reviewed 46 curriculum development projects and reported that only 19 
of the projects used a control group in their evaluations. Actually 
Cronbach (1963) raised questions concerning comparative experimental 
studies in curriculum evaluation. However Guba (1969) pointed out 
that workable alternatives have not been proposed and Scriven (1967) 
argued strongly for comparative studies. He said that it is often 
the case that comparative evaluations are very much easier than non- 
comparative evaluations, because we can frequently use tests which 
would yield differences instead of having to find an absolute scale 
and then eventually compare absolute scores. Data will be collected 
on large samples of graduating students from other teacher-training 
programs for the purposes of comparison. Such an evaluation design 
has one major limitation: students have not been randomly assigned 

to either the experimental or the conventional program. Obviously, 
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we cannot order n student to go to a certain university. Fortunately, 
covariate data collected on students before they enter university will 
allow for partial statistical corrections for any pre-existing dif- 
ferences , 

The second, global evaluation has come in for a great deal of 
discussion. Cage (1964) stressed the fact that evaluation directed 
at a general criterion of teacher effect ivenosn has yielded few re- 
liable and usable results. Armstrong (1968) demonstrated that the 
evaluator who uses a global measure to assess effects of n program 
may discover no significant differences (comparison with a control 
group) became of cancelling interactive effects. A variety of other 
evaluators Have observed the same thing, The logical step is to make 
separate evaluations of each of the components or dimensions of the 
program, One of the first steps in Phase III of the Project v?iil be 
to specify the relevant components. The separate evaluation of the 
components of a project is frequently identified with the modern trend 
in evaluation. 

It has been suggested that sunmatlvc evaluation involves the 
measurement of competing programs on performance or goal scales and 
the integration of the data into a conclusion of superiority for one 
program, Unfortunately, evaluation methodologists have given prac- 
tically no attention to the methods of integrating information into a 
summative judgment. Thus at the present time, this is one of the most 
important unresolved questions in evaluation moi.hodolugy (Glass, 1969). 
Until a solution to the problem is obtained, the weighted -sum model 
is proposed for use in MET IP „ In this model, competing programs are 
compared on a large set, of scales. The program receiving the highest 
total score on the scales would be preferred. In addition to com- 
paring METEP with conventional programs it is highly recommended that 
it be compared with the other experimental programs. 

Another evaluation strategy which emphasizes measuring the extent 
to which the objectives of the project are met will be used. The steps 
will include specifications of the objectives in behavioral terms, and 
later measuring the outcomes. We \7ill be interested in determining 
the extent to which our goals relating to attitude, achievement, in- 
terest, etc, are obtained by the graduating students. There are how- 
ever, at least three problems related to this approach r 

The first problem raised by Scriven (1967) concerns the goals 
themselves. He ar. led that it is not good enough to know how close 
students come to achieving objectives of the program. It is important 
to know how valid those objectives are. The second problem (which is 
research based) concerns the methods for measuring achievement of the 
objectives. Finally, Atkin (1963, 1968) pointed out that there is 
more to evaluation than measuring the extent to which objectives are 
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achieved, lie pointed out the importance of unplanned, unanticipated 
learning, Atkin also criticized the objectives approach because it 
focused on short-term behavioral changes rather than the possibly more 
important long-term goals. A great deal of work will be done on the 
comments and criticisms of Striven (1967) and Atkin (1968) before the 
final formulation of the summative evaluation plans are completed. 

Tlie techniques used in surmnative evaluation v/ill include pro*' 
j cct-deve loped achievement tests, standardized achi evement tests , 
questionnaires, attitude and interest measures. The battery of tests 
described earlier which is to be administered at the end of the program 
will also provide useful information. 

An integral part of the evaluation will include determining the 
extent to which the program is acceptable to a variety of clients: 
students, teachers, and principals. Students will be queried on their 
likes and dislikes in the program, and their perceptions of the ad- 
vantages and disadvantages. Teachers and principals will be asked to 
rate the students on a variety of skills at various stages of their 
development (one years 1 teaching experience, three years* experience, 
etc,). Ratings will also be obtained on graduates of conventional 
programs and comparisons will be made. 

Finally, an attempt will be made to incorporate a curriculum 
evaluation model developed by Gortli cjL nl. (1969c) called Cu.^lc ,en- 
sive Achievement Monitoring (CAM) into METER on an experimental 
basis. Gortli (personal communication) described CAM as a system of 
curriculum evaluation which is organized to include each of the neces- 
sary components of an evaluation and which lias the flexibility co 
provide needed addition information. 

The CAM system utilizes a computer-centered test generation, 
test scoring, test analysis, and information reporting design. The 
computer provides the quick processing and sophistication of analysis 
needed in the effective curriculum evaluation. It presently allows 
CAM to administer, analyze and report results in terms of each per- 
formance criterion to more than 2000 students on a bi-weekly test 
schedule . 

Flexibility is built into the CAM system because (1) the eva- 
luation is specific to the performance criterion and (2) there are 
repeated measures of the student’s achievement on each performance 
criterion. The evaluation of the curriculum is based upon the stu- 
dent’s own report of the performance criterion lie has chosen to work 
on. If he lias not worked on a particular performance criterion, 
then his test results would not include an evaluation of his perfor- 
mance on that one. Mien lie indicates that lie lias completed a per- 
formance criterion, he is evaluated soon after, and also repeatedly 
tested for retention of knowledge and ability in that performance 
criterion. 



599 



Basic Research 



t 



In this section we will outline briefly some of the proposed 
research for METEP. By definition t lie results of the research 
studies will be gencrulizable. This will be so, provided enough at- 
tention is given to the specification of treatments and designs of 
the studies (Witt rock, 19b6). In this regard, Campbell and Stanley V. 
(1963) summary of experimental designs will be. most helpful. (Current 
developments on design and data analysis in evaluation and research 
have been recently reviewed by Baker [1969] and Welch [1969]). But 
in order to facilitate the research, it will be necessary tc impose 
constraints on the students such as randomly assigning them to spe- 
cified instructional alternatives. Resigns in which students are 
randomly assigned to treatments are considered true experiments. In 
describing true experiments Campbell and Stanley (1963) wrote: 

11 [They are] the only means for settling disputes regarding educational 
practice, the only way of verifying educational improvement..." 

One of t lie attractive features of METEP is that it provides an 
opportunity to individualize educational experiences. It is essen- 
tial to match teachers, materials, and students in order to create 
optimal individual learning situations. In order to maximize the 
gain for the student from this unique learning experience, we must 
gather a wide variety cf aptitude- treatment interaction data. This 
will help us learn what kinds of students leavn roost under what kinds 
of conditions. This information will be invaluable when student guid- 
ance is needed in selecting programs. We will attempt t.o find in- 
structional alternatives that produce superior results for learners of 
different characteristics. In this research, aptitude v T ill be de- 
fined rather broadly to include personality factors, Intellectual fac- 
tors, aptitudes (as they are conventionally defined), socio-economic 
background, etc. 

Another area about which very little is known concerns the rele- 
vant variables for predicting success in teacher-training programs. 
With the wide assortment of data available this kind of research is 
possible. Research results bearing on this important question will 
have obvious implications. Similar studies will be conducted in the 
schools serving as control groups and comparisons wJ13. be made be- 
tween the prediction equations, etc. 

In addition to aptitude-treatment interaction and prediction 
studies there exist a wide variety of other studies which will be 
conducted. To name a few, at the moment a great deal of research is 
centered around testing methodology. For example, researchers are 
developing procedures for extracting more information from a student’s 
responses to multiple choice tests. Further research on scoring 
fomulas (Traub, Uninblcton 6 Singh, 1969), confidence testing and 
item weighing systems (Shuford, Albert and Massengill, 1966; Rippcy, 
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1968; Ratable ton, Roberts and Traub, I960) provide potential means for 
increasing reliability ami validity of the criterion tests, Compu- 
terized testing offers many exciting prospect3 - individual! zed tests, 
more efficient testing (Cleary, 1/1 mi and Rock, 196b). New techniques 
sueli as general ized factor analysis (McDonald, 1969) offer interesting 
new methods for analyzing semantic differential data. Move conven- 
tional factor analyser* can be used to investigate a wide selection of 
hypotheses abou • interrelationships among many of ihv. variables under 
investigation* 

Perhaps more important research will relate to recent develop- 
ments in micro- teaching (Goldchwaite, i960) and some of his surprising 
findings. The work of Yec (1969) on guidelines for matching students 
v j tli cc-opcrating teachers has obvious implications for MLIER. How- 
ever, there exist many unresolved problems here. At the present, 
there is a great, deal of work to be done, on the construction of scale s 
to measure teacher effectiveness (Biddle and Kllcm, 1963) in which 
the tenets of psychological scaling are used (Torgcrscn, 1958; Beck 
ami Jones, 1968), Of ecu*. so, these scales could later be used in 
other teacher- training colleges. 

The problem of determining the cut-off point between passing 
and failing on the performance criterion tests v?ill be a difficult one 
to solve * Do ve want to use the same level of prof iciency on each 
performance criterion? What level of proficiency must vc use on the 
performance criterion test to insure a high level ot prelieieney cn 
the same perfomance criterion at a later date? 

Other potential research areas include work on item sampling mo- 
dels (Lord, 196?) and the Hawthorne Effect (Cook, 1968). 



Evaluation and Research CornmiLtee 

In order to oversee the evaluation and research of METKP 1*. is 
recommend d that a committee of five headed by a co-ordinator be 
appointed. In addition it would be exported that a variety of re- 
search associates with statistics, research design, and computer pro- 
gramming skills, along with a number of graduate students, vould be 
available to help with the work of the committee. In addition to 
designing and cooidinating the evaluation and research component, the 
cotnmittce would serve as a review board for research proposals. 



Dissemination 



Results of formative and sunvnalivc evaluations and research 
findings will be distributed through iho usual channels. These will 
include technical reports, publication of findings in relevant jour- 
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naltf, presentation of papers at conferences, dissertations am! news 
releases to ncv?spnpers, television and radio, It is also expected 
that school supervisors, principals, and other interested parties 
will be kept up to date by periodic symposia held at the. University • 



Imp 1 o mo n t a lio n , The activities required for the inpl ementntion of 
the rcscardi ano evaluation subsystem are graphical ly presented in 
Figure 1. The operation of this subsystem is to provide research 
and evaluation services for the program. Therefore, as n^.w on re- 
vised needs are identified, many of the steps outlined in the acti- 
vity network chart will be continuously repeated. 
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now V/ 1 tiii: lionix insure and ilajntain its klm;van’ci; 

KOK TRACU]:il EDUCATION IN TIIK 1970's? 



Kocogni aing 1 1 1 ;i I. an elc;noiUary teacher rnhiraMon program devel- 
oped in 1968 my not bo completely relevant for the 19 70'n va have 
taken several olejia to insure lli.M our program does not become 
static am! inflexible in response to changing needs. The. first 
precaution is the assumption that the program we have designed for 
1908 will not be the sa x* program in 1975. The structure of our 
program is designed to allow for constant revision and op-grading. 
Highlights of our program consist of bchavJ orally stated outcomes 
expected of the trainee* multiple instructional alternatives for 
achieving those expected outcomes , and the ability to add or subtract 
areas of speciali/rU ion* The specific performance criteria required 
of the trainees and the accompanying instructional alternatives are 
tentative hypotheses about the required training for elementary 
teachers. They are not interpreted as fixed, hut rather subject to 
change based upon evaluation analysis . 

As change and development become increasingly important, 
effective models must be responsive to the inform tiuii from 

their operation and frim their environment Information 

about the inputs and the environment are collected, and 

statements of goals and purposes are formulated Appropriate 

adjustments -an be made in the syst o ’ ,,, s op^i et fon h^qpd m> 
this information or in conformance with changing goals or 
standards . 



The MF/fiJP system is designed to systonuili cai ly assess both its 
internal and external environments. As LeDaron has noted above, 
feedback from the external environment is necessary in order to 
continually assess IIKTEP goals with those clients who are affected 
by the program and the teachers who graduate from the program. 3y 
continually collecting information relating to societal changes 
and the changing role of the elementary teacher, the rvijor aspects 
of the environment can be sys temat icall) assessed. 

MlTKP , as a teacher eduefttion progran, has at least seven differ- 
ent client groups, lhose clients are affected either directly or 
indirectly by the program and the teachers who graduate from the 
progran. These include'. 



^alt LeBaron, ’’Techniques for Developing an Eles>entary Teacher 
Education Model," lufi.O.r., Bureau of Research, Contract #OEC-0-9- 
569006-3704 (010), July, 1969, pp. 8-9. 
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1. 


students in the. liETIiP program 




2. 


public school teachers 




i. 


pub J J.c school adnini.slrn tors 




A. 


children in demon tar y schools 




5 • 


pinouts of children in dement my 


school s 


C , 


professional educators in teacher 


e ducat ion 


7. 


statu departments of education 




Onu 


function to he performed in MET)-)* 


is the analysis of client 



demands • This function represents a cental l monitoring effort on the 
part of KK'JEP to ascertain client needs and demands. In one way or 
another, all of the above client groups ore affected by l be MKTEP 
program and their needy and demands should be syatemoU rally collect- 
ed and considered in the decisJon-muUing process vis-a-vis curriculuM 
components, instructional alternatives, etc. Since clients end soci- 
ely will change over time, their needs will «i]s^ change. The moni“ 
toring protean of METLP must he sensitised to such changes, 

In addition to monitoring client needs, there eve other environ- 
mental states which need to be systemati tally assessed to insure re- 
levancy for the future. Inetc includes 

1, economic environment 

2, political environ rent 

3, sociological environment 

4 * r uvuivj g j v. a 1 C mV 1 v on iivH t 

5 i technologi cal envi ronnent 

6. psychological environment 

Another function of the METEP system is to dc\elop various 
screening and scanning devices to assess changes in these environments. 

1, Economic environment - A changing economic environment, means 
that HETLi f s clients 11 needs must bo balanced against 
the realities of economics. For instance, a recession 
in American society could significantly alter client 
needs; o.g. the students In HETEP may change because 
certain students m y not be able to attend college. 

2, Political environment - Enacted cr proposed legislation 
may either impose restraints or provide new opportuni- 
ties, .decisions obtained through election results... 
approval or defeat of bond issues .... all may have serious 
implications on the design or implementation of HETEP. 

3, Sociological environment *• Changes in roles, expecta- 
tions, and status can directly or indirectly affect 
METEP. Changes in the role of the elementary teacher 
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is tli g most obvious example of how a sociological change 
could a f f^ct MliTHP. 

4. Ideological environment; - The ideological environment 
is concerned vi Ui society's value system. The value 
changes of college students in recent years is an ex- 
cellent example of how a teacher education program 
could be affected. The demand of students to partici- 
pate in planning their own futures is the kind of .. 
change which has tremendous implications. 

5. Technological environment - Innovation can lead to 
changed and Improved performance in the operation of 
MKTL1* . New computer usages could, for example, 
drastically reduce the information system’s cost. 

6. Psychological environment - It is important to under- 
stand how individuals respond to environmental change 
because MLTPP will be in constant communication with 
various parts of the public sector. tlETKP should be 
able to know and predict the reactions of various 
client groups, especially wuen dealing with changes 
or modifications in the program. 



Pe dago gical Plans fee the 70 1 s . i he rest important feature of the 
performance curriculum as developed and envisioned by the pedagogi- 
cal teams is cunt imnij shor t- te rm and lo ng-term planning and action 
f or c onstant change and r evisi on In pot fortune e criteria and Inst ruc^- 
tional alternatives . The very process of curriculum development is 
a dangerous procedure for when one commits oneself to action (no mat- 
ter how wise), alternative organisational aid action plans are simul- 
taneously committed to inaction. In another unique situation these 
same discarded plans (or new ones which mi) he synthesized) may prove 
more relevant than old plans. As such, constant change, development 
of new approaches, and program evaluation are vital. 

Already the pedagogical teams have been engaged in large-scale 
teorientat ion of curricula. At the immediate level, for example, 
the mathematics and language arts teams are developing rev instruc- 
tional alternatives and new performance curriculum hierarchies. 

The science team is developing a new, flexible way of utilizing space 
for laboratory work in science education which combines elementary 
children and beginning teachers in new ways of learning. The social 
studies and human relations team arc beginning preliminary explora- 
tions of articulation and coordination between the curricula. 

Important in this change process is student feedback and parti- 
cipation. For example, the human relations team at the completion 
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of each performance curriculum hierarchy solicited suggestions from 
the students for changing and sharpening the material they hac! just 
completed, These same students during the coming term will serve as 
a team which will help in the development of new hierarchies of 
training in human relations. 

Thus, several important dimensions of maintaining short-term re- 
levance and changes can be summarized; 

1. Staff evaluation of program and change through eva- 
luation and research. 

2. Student participation in decision making and curri- 
culum development , 

3. Development of articulation between programs to en- 
sure smooth coordination. 

4. Not mentioned above, hut equally important will be 
feedback from the support and maintenance teams in 
terms of computer scheduling, guidance of students, 
and data on the use of instructional alternatives. 

Long-term planning requires a more complex program of evaluation 
and coordination. Perhaps the most important and 'interesting of 
these Involves potential res Lruct l ae uf th e en tire concept of ele- 
mentary te acher tra inin g . 



While articulation between subject matter fields has always been 
stressed in teacher training programs, the methods through which tills 
articulation can be brought about are Jess clear. The breaking down 
of specific elements of teacher training skills in each of t;lie five 
training areas, science, language arts, social studies, mathematics, 
and human relations has revealed many skills which are parallel, and 
in some cases even exactly the same. For example, the skills of 
model building within the knowledge component of social studies are 
close to the decision making hierarchy developed by human relations. 
While the content of the two programs differ, the structure or under- 
lying process is similar. The skills of scientific observation 
stressed in science are similar to the behavioral constructs of at- 
tending behavior within human relations. Many other such parallel 
examples could be presented. 

In viewing similarities of structure in the learning process 
which is teacher education, it may be possible to develop new con- 
cepts of teacher education itself, One possibility might be a cur- 
riculum based on entirely on skill areas such as observation, classi- 
fication, and analysis. These three components could be used in all 
five subject matter areas of the elementur-y training program. As 
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performance criteria arc relatively small* discrete units, it is re- 
latively ops y to reorder presently existing materials into now orga- 
nisational .structures. One can visualise the value lo the student 
in a program in which the structure of each content area is parallel 
to other areas . 



A structural approach such ns this has many implications. The 
first* and most obvious is the ease for students who once they learn 
a basic structure can use this same structure to solve problems in 
many discrete areas. As presently instituted, each Hire a student 
enters a new curriculum area, he lias to learn both the content and 
structure of that area. If structures were parallel, the program 
can focus more quickly anu easily on basic content. 

A second and less obvious implication is that like the two-edged 
sword, this structural approach to curriculum "cuts two ways." Stu- 
dents, if bound to one structure may be unable to visualize alterna- 
tive ways of restructuring the curriculum mid could actually lose 
flexibility within this approach. As such, it seems essential- that 
one component within this program is theory and practice in structure 
building. Students would be encouraged to develop alternative ways 
of restructuring curriculum units both for themselves in the MKTEP 
program and in thei r own teaching practice. At higher levels, stu- 
dents and staff could dove]. op new ways of restructing the entire METEL 1 
program to meet relevant needs. 

For example, if societal needs stress the importance of environ- 
mental pollution as a major problem, the concepts and performance 
curricula of the subject matter fields could be organised around this 
one concept. In a teacher training program which centered on concepts 
of environmental pollution the performance criteria areas could be 
restructured around this problem without loss of content from the basic 
areas. (However, it is expected that the "basic areas" might soon 
themselves be restructured into new relationships and dimensions) . 

As a new idea is developed, the curricula might again be restructured, 
perhaps around the constructs of anthropology, physics, or even life 
in space. 



This latter material may perhaps sound vague, futuristic, and 
pei'haps even a bit schizophrenic. However, it is presented with the 
firm lelief that the major value of the performance curriculum con- 
cepts is that it makes possible the* restructing of educational and 
social environments in ways that before were impossible. Tbit? re- 
structuring is always done with an intelligent eye to the past and 
no single restructuring actually is scon as an end in itself. Too 
long the present curriculum areas have been viewed as established 
tradition. The concepts of the performance curriculum make possible 
the development of many now and alternative ways of restructuring 
the educational environment. 



In summary, the views for long-term development may be stated 
briefly as follows; 

1, The presently existing performance curriculum has re- 
quired file pedagogical teams to "break-down 11 their 
specialities into specific components, 

2, Components in each field have been discovered to be 
similar, and in some cases exactly the same, as com- 
ponents in other fields, 

3, If components are parallel, it is possible to teach as- 
pects of different subject matter fields within one 
performance criterion. For example, model building 

in social studies, classification in science, and de- 
cision making in human relations all involve many of 
the same interpersonal and knowledge skills, 

4, If components are similar, it should be possible to 
restructure the elementary teacher education curricu- 
lum around these specific areas which are analogous 
one to another. 

5, Such a structure makes it possible for students to 
see more clearly the relationship of subject matter 
fields and eventually a deeper emphasis on content 
may be possible. 

6, It is believed that there is no final structure for 
the curriculum and it is anticipated that restructur- 
ing within this basis would be an on-going and constant 
activity. 

In summary, then, METEP is concerned with developing an organiza- 
tional process that will be responsive and adoptive to change. This 
function will be called Client Analysis (see Management Section), 
and will involve assessing client needs and environmental changes 
which could affect the METEP program. 
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